Apr 02 12:29:39 devstack cinder-volume[72904]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 02 12:29:39 devstack cinder-volume[72904]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 02 12:29:39 devstack cinder-volume[72904]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 02 12:29:40 devstack cinder-volume[72904]: INFO dbcounter [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Registered counter for database cinder Apr 02 12:29:40 devstack cinder-volume[72904]: DEBUG oslo_db.sqlalchemy.engines [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72904) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 12:29:40 devstack cinder-volume[72904]: DEBUG dbcounter [-] [72904] Writer thread running {{(pid=72904) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 02 12:29:40 devstack cinder-volume[72904]: INFO cinder.rpc [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 02 12:29:40 devstack cinder-volume[72904]: INFO cinder.rpc [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 02 12:29:40 devstack cinder-volume[72904]: DEBUG oslo_db.sqlalchemy.engines [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72904) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 12:29:40 devstack cinder-volume[72904]: INFO cinder.volume.manager [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Determined volume DB was empty at startup. Apr 02 12:29:40 devstack cinder-volume[72904]: DEBUG cinder.volume.manager [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72904) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 02 12:29:40 devstack cinder-volume[72904]: INFO cinder.volume.manager [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 02 12:29:40 devstack cinder-volume[72904]: WARNING stevedore.named [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 02 12:29:40 devstack cinder-volume[72904]: WARNING castellan.key_manager [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 02 12:29:40 devstack cinder-volume[72904]: WARNING cinder.keymgr.conf_key_mgr [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 02 12:29:40 devstack cinder-volume[72904]: DEBUG cinder.volume.drivers.lvm [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72904) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 02 12:29:40 devstack cinder-volume[72904]: DEBUG oslo_concurrency.processutils [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_concurrency.processutils [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] CMD "cinder-rtstool verify" returned: 0 in 0.240s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_db.sqlalchemy.engines [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72904) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 12:29:41 devstack cinder-volume[72904]: INFO cinder.rpc [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 02 12:29:41 devstack cinder-volume[72904]: INFO cinder.rpc [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 02 12:29:41 devstack cinder-volume[72904]: WARNING stevedore.named [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 02 12:29:41 devstack cinder-volume[72904]: WARNING castellan.key_manager [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 02 12:29:41 devstack cinder-volume[72904]: INFO cinder.volume.manager [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_db.sqlalchemy.engines [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72904) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 12:29:41 devstack cinder-volume[72904]: INFO oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Starting 1 workers Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Started child 73011 {{(pid=72904) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Full set of CONF: {{(pid=72904) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] ******************************************************************************** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Configuration options gathered from: {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] ================================================================================ {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] allow_availability_zone_fallback = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] allow_compression_on_image_upload = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] allowed_direct_url_schemes = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] api_rate_limit = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] auth_strategy = keystone {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] az_cache_duration = 3600 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_availability_zone = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_host = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_name = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[73011]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_stats_polling_interval = 60 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backup_api_class = cinder.backup.api.API {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backup_name_template = backup-%s {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backup_use_same_host = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backup_use_temp_snapshot = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] chap_password = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] chap_username = {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cinder_internal_tenant_project_id = a19435a9ba1346f8ba6fcd00394e5fa6 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cinder_internal_tenant_user_id = 12d6a4f6ec3b4e278075b3688645a321 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cloned_volume_same_az = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cluster = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] compression_format = gzip {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] compute_api_class = cinder.compute.nova.API {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] config_dir = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] config_source = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] control_exchange = openstack {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] debug = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] default_availability_zone = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] default_group_type = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] default_volume_type = lvmdriver-1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] disk_geometry = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] driver_client_cert = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] driver_client_cert_key = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] driver_data_namespace = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] driver_ssl_cert_path = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] driver_ssl_cert_verify = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] driver_use_ssl = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] enable_force_upload = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] enable_new_services = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] enable_unsupported_driver = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] enforce_multipath_for_image_xfer = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] filter_function = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] glance_api_insecure = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] glance_api_servers = ['http://192.168.122.186/image'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] glance_api_ssl_compression = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] glance_ca_certificates_file = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] glance_catalog_info = image:glance:publicURL {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] glance_certfile = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] glance_keyfile = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] glance_num_retries = 3 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] glance_request_timeout = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] goodness_function = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] graceful_shutdown_timeout = 5 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] group_api_class = cinder.group.api.API {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] host = devstack {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] image_compress_on_upload = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] image_conversion_address_space_limit = 1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] image_conversion_cpu_limit = 60 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] image_conversion_disable = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] image_upload_use_cinder_backend = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] image_upload_use_internal_tenant = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] image_volume_cache_enabled = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] image_volume_cache_max_count = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] image_volume_cache_max_size_gb = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] init_host_max_objects_retrieval = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] instance_format = [instance: %(uuid)s] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] iscsi_target_flags = {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] iscsi_write_cache = on {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] iser_helper = tgtadm {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] iser_ip_address = 192.168.122.186 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] iser_port = 3260 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] log_color = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] log_config_append = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] log_dir = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] log_file = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] log_options = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] log_rotate_interval = 1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] log_rotate_interval_type = days {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] log_rotation_type = none {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] max_age = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] max_logfile_count = 30 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] max_logfile_size_mb = 200 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] max_over_subscription_ratio = 20.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] message_reap_interval = 86400 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] message_ttl = 2592000 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] migration_create_volume_timeout_secs = 300 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] monkey_patch = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] monkey_patch_modules = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] my_ip = 192.168.122.186 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] no_snapshot_gb_quota = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] num_iser_scan_tries = 3 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] num_shell_tries = 3 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] num_volume_device_scan_tries = 3 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] nvmeof_conn_info_version = 1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] nvmet_ns_id = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] nvmet_port_id = 1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] osapi_max_limit = 1000 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] osapi_volume_ext_list = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] osapi_volume_listen_port = 8776 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] osapi_volume_use_ssl = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] osapi_volume_workers = 2 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] per_volume_size_limit = -1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] periodic_fuzzy_delay = 60 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] periodic_interval = 60 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[73011]: INFO cinder.volume.manager [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 02 12:29:41 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] public_endpoint = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] publish_errors = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] quota_backup_gigabytes = 1000 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] quota_backups = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] quota_gigabytes = 1000 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] quota_groups = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] quota_snapshots = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] quota_volumes = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] rate_limit_burst = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] rate_limit_except_level = CRITICAL {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] rate_limit_interval = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] reinit_driver_count = 3 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] replication_device = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] report_discard_supported = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] report_interval = 120 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] reservation_clean_interval = 86400 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] reservation_expire = 86400 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] reserved_image_namespaces = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] reserved_percentage = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] rpc_response_timeout = 120 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] run_external_periodic_tasks = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] scst_target_driver = iscsi {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] scst_target_iqn_name = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] service_down_time = 720 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] shell_completion = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] snapshot_name_template = snapshot-%s {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] snapshot_same_host = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] split_loggers = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] state_path = /opt/stack/data/cinder {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] storage_availability_zone = nova {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] storage_protocol = iSCSI {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] syslog_log_facility = LOG_USER {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] target_helper = lioadm {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] target_ip_address = 192.168.122.186 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] target_port = 3260 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] target_protocol = iscsi {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] target_secondary_ip_addresses = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] trace_flags = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] transport_url = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] until_refresh = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] use_chap_auth = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] use_default_quota_class = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] use_journal = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] use_json = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] use_multipath_for_image_xfer = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] use_stderr = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] use_syslog = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] verify_glance_signatures = enabled {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] volume_api_class = cinder.volume.api.API {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] volume_backend_name = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] volume_clear = zero {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] volume_clear_ionice = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] volume_clear_size = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] volume_copy_bps_limit = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] volume_dd_blocksize = 1M {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] volume_name_template = volume-%s {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] volume_service_inithost_offload = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] volume_usage_audit_period = month {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] zoning_mode = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_concurrency.disable_process_locking = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:41 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.admin_password = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.admin_token = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.admin_user = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.auth_port = 35357 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.auth_protocol = https {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.auth_section = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.auth_type = password {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.auth_uri = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.auth_version = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.cache = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.certfile = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:41 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.identity_uri = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.include_service_catalog = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.insecure = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.interface = public {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.keyfile = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.memcache_password = {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.memcache_username = {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.region_name = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.service_type = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.186/identity {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.backend = dogpile.cache.null {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.backend_argument = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.backend_expiration_time = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.config_prefix = cache.oslo {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.debug_cache_backend = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.enable_retry_client = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.enable_socket_keepalive = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.enabled = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.enforce_fips_mode = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.expiration_time = 600 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.hashclient_retry_attempts = 2 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.memcache_dead_retry = 300 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.memcache_pool_maxsize = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.memcache_sasl_enabled = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.password = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.proxies = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.redis_db = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack sudo[73021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack sudo[73021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.redis_server = localhost:6379 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.retry_attempts = 2 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.retry_delay = 0.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.socket_keepalive_count = 1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.socket_keepalive_idle = 1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.socket_keepalive_interval = 1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.socket_timeout = 1.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.tls_allowed_ciphers = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.tls_cafile = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.tls_certfile = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.tls_enabled = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.tls_keyfile = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cache.username = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] coordination.backend_url = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] database.asyncio_connection = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] database.asyncio_slave_connection = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] database.backend = sqlalchemy {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] database.connection = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] database.connection_debug = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] database.connection_parameters = {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] database.connection_recycle_time = 3600 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] database.connection_trace = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] database.db_inc_retry_interval = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] database.db_max_retries = 20 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] database.db_max_retry_interval = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] database.db_retry_interval = 1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] database.max_overflow = 50 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] database.max_pool_size = 5 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] database.max_retries = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] database.mysql_wsrep_sync_wait = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] database.pool_timeout = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] database.retry_interval = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] database.slave_connection = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] database.sqlite_synchronous = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] database.synchronous_reader = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] database.use_db_reconnect = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] profiler.connection_string = messaging:// {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] profiler.enabled = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] profiler.es_doc_type = notification {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] profiler.es_scroll_size = 10000 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] profiler.es_scroll_time = 2m {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] profiler.filter_error_trace = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] profiler.hmac_keys = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] profiler.sentinel_service_name = mymaster {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] profiler.socket_timeout = 0.1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] profiler.trace_requests = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] profiler.trace_sqlalchemy = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] profiler_jaeger.process_tags = {} {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] profiler_jaeger.service_name_prefix = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] profiler_otlp.service_name_prefix = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_policy.enforce_new_defaults = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: WARNING oslo_config.cfg [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_policy.enforce_scope = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_policy.policy_default_rule = default {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_policy.policy_file = policy.yaml {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] privsep_osbrick.group = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] privsep_osbrick.helper_command = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] privsep_osbrick.user = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cinder_sys_admin.group = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cinder_sys_admin.helper_command = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] cinder_sys_admin.user = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] service_user.auth_section = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] service_user.auth_type = password {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] service_user.cafile = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] service_user.certfile = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] service_user.collect_timing = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] service_user.insecure = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] service_user.keyfile = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] service_user.send_service_user_token = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] service_user.split_loggers = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] service_user.timeout = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] glance.auth_section = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] glance.auth_type = password {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] glance.certfile = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] glance.collect_timing = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] glance.insecure = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] glance.keyfile = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] glance.region_name = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] glance.split_loggers = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] glance.timeout = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.backend_availability_zone = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.chap_password = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.chap_username = {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.disk_geometry = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.driver_client_cert = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.driver_client_cert_key = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.driver_data_namespace = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.driver_use_ssl = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.extra_capabilities = {} {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.filter_function = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.goodness_function = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.iscsi_target_flags = {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.iscsi_write_cache = on {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.iser_helper = tgtadm {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.iser_ip_address = 192.168.122.186 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.iser_port = 3260 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.lvm_share_target = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.lvm_type = auto {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.num_shell_tries = 3 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.replication_device = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.report_discard_supported = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.reserved_percentage = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.target_helper = tgtadm {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.target_ip_address = 192.168.122.186 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.target_port = 3260 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.target_protocol = iscsi {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.trace_flags = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.unique_fqdn_network = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.use_chap_auth = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.volume_backend_name = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.volume_clear = zero {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.volume_clear_ionice = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.volume_clear_size = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_reports.file_event_handler = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_reports.log_dir = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.backend_host = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.chap_password = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.chap_username = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.disk_geometry = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.driver_client_cert = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.extra_capabilities = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.filter_function = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.goodness_function = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.iser_helper = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.iser_ip_address = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.iser_port = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.lvm_share_target = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.lvm_type = auto {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.num_shell_tries = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.replication_device = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.report_discard_supported = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.reserved_percentage = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.scst_target_driver = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.storage_protocol = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.target_helper = lioadm {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.target_ip_address = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.target_port = 3260 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.trace_flags = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.use_chap_auth = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.volume_clear = zero {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.volume_clear_size = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] lvmdriver-1.volumes_dir = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.ssl = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_notifications.driver = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_notifications.retry = -1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] key_manager.fixed_key = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] barbican.barbican_api_version = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] barbican.barbican_endpoint = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] barbican.barbican_endpoint_type = public {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] barbican.barbican_region_name = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] barbican.cafile = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] barbican.certfile = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] barbican.collect_timing = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] barbican.insecure = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] barbican.keyfile = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] barbican.number_of_retries = 60 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] barbican.retry_delay = 1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] barbican.send_service_user_token = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] barbican.split_loggers = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] barbican.timeout = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] barbican.verify_ssl = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] barbican.verify_ssl_path = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] barbican_service_user.auth_section = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] barbican_service_user.auth_type = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] barbican_service_user.cafile = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] barbican_service_user.certfile = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] barbican_service_user.collect_timing = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] barbican_service_user.insecure = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] barbican_service_user.keyfile = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] barbican_service_user.split_loggers = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] barbican_service_user.timeout = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] vault.approle_role_id = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] vault.approle_secret_id = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] vault.kv_mountpoint = secret {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] vault.kv_path = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] vault.kv_version = 2 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] vault.namespace = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] vault.root_token_id = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] vault.ssl_ca_crt_file = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] vault.timeout = 60.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] vault.use_ssl = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:29:41 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] ******************************************************************************** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 02 12:29:41 devstack sudo[73021]: pam_unix(sudo:session): session closed for user root Apr 02 12:29:41 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.577s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:41 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:41 devstack sudo[73182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 12:29:41 devstack sudo[73182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:29:42 devstack sudo[73182]: pam_unix(sudo:session): session closed for user root Apr 02 12:29:42 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.541s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:42 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 12:29:42 devstack cinder-volume[73011]: INFO cinder.brick.local_dev.lvm [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 02 12:29:42 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:42 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:42 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:42 devstack sudo[73381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 02 12:29:42 devstack sudo[73381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:29:42 devstack sudo[73381]: pam_unix(sudo:session): session closed for user root Apr 02 12:29:42 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.555s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:42 devstack cinder-volume[73011]: DEBUG cinder.brick.local_dev.lvm [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73011) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 02 12:29:42 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:42 devstack sudo[73540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 12:29:42 devstack sudo[73540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:29:43 devstack sudo[73540]: pam_unix(sudo:session): session closed for user root Apr 02 12:29:43 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.937s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:43 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:43 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:43 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:43 devstack sudo[73683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 12:29:43 devstack sudo[73683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:29:44 devstack sudo[73683]: pam_unix(sudo:session): session closed for user root Apr 02 12:29:44 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.453s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:44 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:44 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:44 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:44 devstack sudo[73715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 02 12:29:44 devstack sudo[73715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:29:44 devstack sudo[73715]: pam_unix(sudo:session): session closed for user root Apr 02 12:29:44 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.416s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:44 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:44 devstack sudo[73721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 02 12:29:44 devstack sudo[73721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:29:45 devstack sudo[73721]: pam_unix(sudo:session): session closed for user root Apr 02 12:29:45 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:45 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:45 devstack sudo[73726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 02 12:29:45 devstack sudo[73726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:29:45 devstack sudo[73726]: pam_unix(sudo:session): session closed for user root Apr 02 12:29:45 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:45 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:45 devstack sudo[73730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 12:29:45 devstack sudo[73730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:29:46 devstack sudo[73730]: pam_unix(sudo:session): session closed for user root Apr 02 12:29:46 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.480s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:46 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:46 devstack sudo[73735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 12:29:46 devstack sudo[73735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:29:46 devstack sudo[73735]: pam_unix(sudo:session): session closed for user root Apr 02 12:29:46 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.433s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:46 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:46 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:46 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:46 devstack sudo[73742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 12:29:46 devstack sudo[73742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:29:46 devstack sudo[73742]: pam_unix(sudo:session): session closed for user root Apr 02 12:29:46 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.429s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:46 devstack cinder-volume[73011]: INFO cinder.volume.drivers.lvm [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 02 12:29:46 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:46 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:46 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:47 devstack sudo[73746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 12:29:47 devstack sudo[73746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:29:47 devstack sudo[73746]: pam_unix(sudo:session): session closed for user root Apr 02 12:29:47 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.463s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:47 devstack cinder-volume[73011]: DEBUG cinder.volume.drivers.lvm [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Updating volume stats {{(pid=73011) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 02 12:29:47 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:47 devstack sudo[73775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 02 12:29:47 devstack sudo[73775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:29:47 devstack sudo[73775]: pam_unix(sudo:session): session closed for user root Apr 02 12:29:47 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.476s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:47 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:47 devstack sudo[73868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 12:29:47 devstack sudo[73868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:29:48 devstack sudo[73868]: pam_unix(sudo:session): session closed for user root Apr 02 12:29:48 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.484s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:48 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:48 devstack sudo[73904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 12:29:48 devstack sudo[73904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:29:48 devstack sudo[73904]: pam_unix(sudo:session): session closed for user root Apr 02 12:29:48 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.457s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:48 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:48 devstack sudo[74015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 12:29:48 devstack sudo[74015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:29:49 devstack sudo[74015]: pam_unix(sudo:session): session closed for user root Apr 02 12:29:49 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.491s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:49 devstack cinder-volume[73011]: INFO cinder.volume.driver [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Driver hasn't implemented _init_vendor_properties() Apr 02 12:29:49 devstack cinder-volume[73011]: DEBUG cinder.volume.driver [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73011) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 02 12:29:49 devstack cinder-volume[73011]: DEBUG oslo_db.sqlalchemy.engines [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73011) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 12:29:49 devstack cinder-volume[73011]: DEBUG dbcounter [-] [73011] Writer thread running {{(pid=73011) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 02 12:29:49 devstack cinder-volume[73011]: DEBUG cinder.db.sqlalchemy.api [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Building query based on filter {{(pid=73011) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 02 12:29:49 devstack cinder-volume[73011]: DEBUG cinder.image.image_utils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73011) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 02 12:29:49 devstack cinder-volume[73011]: INFO cinder.keymgr.migration [None req-8c17dab2-53ac-472c-9e15-1ee986364c79 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 02 12:29:49 devstack cinder-volume[73011]: DEBUG cinder.volume.drivers.lvm [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Updating volume stats {{(pid=73011) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 02 12:29:49 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:49 devstack sudo[74019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 02 12:29:49 devstack sudo[74019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:29:49 devstack sudo[74019]: pam_unix(sudo:session): session closed for user root Apr 02 12:29:49 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.480s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:49 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:49 devstack sudo[74023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 12:29:49 devstack sudo[74023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:29:50 devstack sudo[74023]: pam_unix(sudo:session): session closed for user root Apr 02 12:29:50 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.460s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:50 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:50 devstack sudo[74029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 12:29:50 devstack sudo[74029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:29:50 devstack sudo[74029]: pam_unix(sudo:session): session closed for user root Apr 02 12:29:50 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.427s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:50 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:50 devstack sudo[74033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 12:29:50 devstack sudo[74033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:29:51 devstack cinder-volume[72904]: DEBUG dbcounter [-] [72904] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72904) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:29:51 devstack sudo[74033]: pam_unix(sudo:session): session closed for user root Apr 02 12:29:51 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.545s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:51 devstack cinder-volume[73011]: DEBUG cinder.manager [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Notifying Schedulers of capabilities ... {{(pid=73011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:29:51 devstack cinder-volume[73011]: INFO cinder.volume.manager [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Driver initialization completed successfully. Apr 02 12:29:51 devstack cinder-volume[73011]: INFO cinder.manager [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Initiating service 2 cleanup Apr 02 12:29:51 devstack cinder-volume[73011]: INFO cinder.manager [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Service 2 cleanup completed. Apr 02 12:29:51 devstack cinder-volume[73011]: DEBUG cinder.service [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Creating RPC server for service cinder-volume {{(pid=73011) start /opt/stack/cinder/cinder/service.py:231}} Apr 02 12:29:51 devstack cinder-volume[73011]: DEBUG cinder.service [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73011) start /opt/stack/cinder/cinder/service.py:237}} Apr 02 12:29:51 devstack cinder-volume[73011]: INFO cinder.volume.manager [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 02 12:29:51 devstack cinder-volume[73011]: DEBUG cinder.volume.drivers.lvm [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Updating volume stats {{(pid=73011) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 02 12:29:51 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:51 devstack sudo[74071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 02 12:29:51 devstack sudo[74071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:29:51 devstack sudo[74071]: pam_unix(sudo:session): session closed for user root Apr 02 12:29:51 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.513s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:51 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:52 devstack sudo[74077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 12:29:52 devstack sudo[74077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:29:52 devstack sudo[74077]: pam_unix(sudo:session): session closed for user root Apr 02 12:29:52 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.474s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:52 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:52 devstack sudo[74083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 12:29:52 devstack sudo[74083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:29:52 devstack sudo[74083]: pam_unix(sudo:session): session closed for user root Apr 02 12:29:52 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.456s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:52 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:29:52 devstack sudo[74140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 12:29:52 devstack sudo[74140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:29:53 devstack sudo[74140]: pam_unix(sudo:session): session closed for user root Apr 02 12:29:53 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:29:53 devstack cinder-volume[73011]: INFO cinder.volume.manager [None req-5577420d-5768-4677-bb2d-0a04a863af5d None None] Driver post RPC initialization completed successfully. Apr 02 12:30:03 devstack cinder-volume[73011]: DEBUG dbcounter [-] [73011] Writing DB stats cinder:SELECT=2 {{(pid=73011) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:30:03 devstack cinder-volume[73011]: DEBUG dbcounter [-] [73011] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=73011) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:30:53 devstack cinder-volume[73011]: DEBUG oslo_service.periodic_task [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73011) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 12:30:53 devstack cinder-volume[73011]: DEBUG cinder.volume.drivers.lvm [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] Updating volume stats {{(pid=73011) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 02 12:30:53 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:30:53 devstack sudo[78872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 02 12:30:53 devstack sudo[78872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:30:53 devstack sudo[78872]: pam_unix(sudo:session): session closed for user root Apr 02 12:30:53 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.421s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:30:53 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:30:53 devstack sudo[78875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 12:30:53 devstack sudo[78875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:30:54 devstack sudo[78875]: pam_unix(sudo:session): session closed for user root Apr 02 12:30:54 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.422s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:30:54 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:30:54 devstack sudo[78878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 12:30:54 devstack sudo[78878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:30:54 devstack sudo[78878]: pam_unix(sudo:session): session closed for user root Apr 02 12:30:54 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.433s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:30:54 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:30:54 devstack sudo[78881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 12:30:54 devstack sudo[78881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:30:55 devstack sudo[78881]: pam_unix(sudo:session): session closed for user root Apr 02 12:30:55 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.420s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:30:55 devstack cinder-volume[73011]: DEBUG cinder.manager [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] Notifying Schedulers of capabilities ... {{(pid=73011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:31:53 devstack cinder-volume[73011]: DEBUG oslo_service.periodic_task [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73011) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 12:31:53 devstack cinder-volume[73011]: DEBUG cinder.volume.drivers.lvm [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] Updating volume stats {{(pid=73011) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 02 12:31:53 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:31:53 devstack sudo[79887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 02 12:31:53 devstack sudo[79887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:31:53 devstack sudo[79887]: pam_unix(sudo:session): session closed for user root Apr 02 12:31:53 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.531s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:31:53 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:31:53 devstack sudo[79910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 12:31:53 devstack sudo[79910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:31:54 devstack sudo[79910]: pam_unix(sudo:session): session closed for user root Apr 02 12:31:54 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.512s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:31:54 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:31:54 devstack sudo[79919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 12:31:54 devstack sudo[79919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:31:54 devstack sudo[79919]: pam_unix(sudo:session): session closed for user root Apr 02 12:31:54 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.437s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:31:54 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:31:54 devstack sudo[79932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 12:31:54 devstack sudo[79932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:31:55 devstack sudo[79932]: pam_unix(sudo:session): session closed for user root Apr 02 12:31:55 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:31:55 devstack cinder-volume[73011]: DEBUG cinder.manager [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] Notifying Schedulers of capabilities ... {{(pid=73011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:32:03 devstack cinder-volume[73011]: DEBUG dbcounter [-] [73011] Writing DB stats cinder:SELECT=1 {{(pid=73011) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:32:03 devstack cinder-volume[73011]: DEBUG dbcounter [-] [73011] Writing DB stats cinder:UPDATE=1 {{(pid=73011) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:32:53 devstack cinder-volume[73011]: DEBUG oslo_service.periodic_task [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73011) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 12:32:53 devstack cinder-volume[73011]: DEBUG cinder.volume.drivers.lvm [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] Updating volume stats {{(pid=73011) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 02 12:32:53 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:32:53 devstack sudo[81496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 02 12:32:53 devstack sudo[81496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:32:53 devstack sudo[81496]: pam_unix(sudo:session): session closed for user root Apr 02 12:32:53 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.496s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:32:53 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:32:53 devstack sudo[81522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 12:32:53 devstack sudo[81522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:32:54 devstack sudo[81522]: pam_unix(sudo:session): session closed for user root Apr 02 12:32:54 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.486s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:32:54 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:32:54 devstack sudo[81528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 12:32:54 devstack sudo[81528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:32:54 devstack sudo[81528]: pam_unix(sudo:session): session closed for user root Apr 02 12:32:54 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.478s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:32:54 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:32:54 devstack sudo[81531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 12:32:54 devstack sudo[81531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:32:55 devstack sudo[81531]: pam_unix(sudo:session): session closed for user root Apr 02 12:32:55 devstack cinder-volume[73011]: DEBUG oslo_concurrency.processutils [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.480s {{(pid=73011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:32:55 devstack cinder-volume[73011]: DEBUG cinder.manager [None req-92317b20-5191-426a-9b02-a866dd3723a9 None None] Notifying Schedulers of capabilities ... {{(pid=73011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:33:31 devstack cinder-volume[72904]: INFO oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Caught SIGTERM, stopping children Apr 02 12:33:31 devstack cinder-volume[72904]: DEBUG oslo_concurrency.lockutils [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Acquiring lock "singleton_lock" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 02 12:33:31 devstack cinder-volume[72904]: DEBUG oslo_concurrency.lockutils [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Acquired lock "singleton_lock" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 02 12:33:31 devstack cinder-volume[72904]: DEBUG oslo_concurrency.lockutils [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Releasing lock "singleton_lock" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 02 12:33:31 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Stop services. {{(pid=72904) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 02 12:33:31 devstack cinder-volume[72904]: DEBUG oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Killing children. {{(pid=72904) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 02 12:33:31 devstack cinder-volume[72904]: INFO oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Waiting on 1 children to exit Apr 02 12:33:36 devstack cinder-volume[73011]: DEBUG oslo_concurrency.lockutils [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Acquiring lock "singleton_lock" {{(pid=73011) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 02 12:33:36 devstack cinder-volume[73011]: DEBUG oslo_concurrency.lockutils [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Acquired lock "singleton_lock" {{(pid=73011) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 02 12:33:36 devstack cinder-volume[73011]: DEBUG oslo_concurrency.lockutils [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Releasing lock "singleton_lock" {{(pid=73011) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 02 12:33:36 devstack cinder-volume[73011]: WARNING amqp [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 02 12:33:36 devstack cinder-volume[73011]: WARNING amqp [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 02 12:33:36 devstack cinder-volume[72904]: INFO oslo_service.backend._eventlet.service [None req-03e228ba-f17e-473b-ad74-790c1535e4c5 None None] Child 73011 exited with status 0 Apr 02 12:33:38 devstack cinder-volume[82285]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 02 12:33:38 devstack cinder-volume[82285]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 02 12:33:38 devstack cinder-volume[82285]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 02 12:33:39 devstack cinder-volume[82285]: INFO dbcounter [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] Registered counter for database cinder Apr 02 12:33:39 devstack cinder-volume[82285]: DEBUG oslo_db.sqlalchemy.engines [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82285) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 12:33:39 devstack cinder-volume[82285]: DEBUG dbcounter [-] [82285] Writer thread running {{(pid=82285) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 02 12:33:39 devstack cinder-volume[82285]: INFO cinder.rpc [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 02 12:33:39 devstack cinder-volume[82285]: INFO cinder.rpc [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 02 12:33:39 devstack cinder-volume[82285]: DEBUG oslo_db.sqlalchemy.engines [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82285) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 12:33:39 devstack cinder-volume[82285]: INFO cinder.volume.manager [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] Determined volume DB was empty at startup. Apr 02 12:33:39 devstack cinder-volume[82285]: DEBUG cinder.volume.manager [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82285) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 02 12:33:39 devstack cinder-volume[82285]: INFO cinder.volume.manager [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 02 12:33:39 devstack cinder-volume[82285]: WARNING stevedore.named [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 02 12:33:39 devstack cinder-volume[82285]: WARNING castellan.key_manager [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 02 12:33:39 devstack cinder-volume[82285]: WARNING cinder.keymgr.conf_key_mgr [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 02 12:33:39 devstack cinder-volume[82285]: INFO cinder.volume.manager [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 02 12:33:39 devstack cinder-volume[82285]: DEBUG oslo_db.sqlalchemy.engines [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82285) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 12:33:40 devstack cinder-volume[82285]: INFO oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] Starting 1 workers Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] Started child 82406 {{(pid=82285) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] Full set of CONF: {{(pid=82285) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] ******************************************************************************** {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] Configuration options gathered from: {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] ================================================================================ {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] allow_availability_zone_fallback = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] allow_compression_on_image_upload = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] allowed_direct_url_schemes = [] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] api_rate_limit = True {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] auth_strategy = keystone {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_availability_zone = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_host = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_name = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_stats_polling_interval = 60 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backup_api_class = cinder.backup.api.API {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backup_name_template = backup-%s {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backup_use_same_host = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backup_use_temp_snapshot = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] chap_password = **** {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] chap_username = {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cinder_internal_tenant_project_id = a19435a9ba1346f8ba6fcd00394e5fa6 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cinder_internal_tenant_user_id = 12d6a4f6ec3b4e278075b3688645a321 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cluster = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] compression_format = gzip {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] compute_api_class = cinder.compute.nova.API {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] config_dir = [] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] config_source = [] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] control_exchange = openstack {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82406]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] debug = True {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] default_availability_zone = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] default_group_type = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] default_volume_type = QuobyteHD {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] disk_geometry = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] driver_client_cert = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] driver_client_cert_key = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] driver_data_namespace = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] driver_ssl_cert_path = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] driver_ssl_cert_verify = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] driver_use_ssl = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] enable_new_services = True {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] enable_unsupported_driver = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] enabled_backends = ['QuobyteHD'] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] enforce_multipath_for_image_xfer = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] filter_function = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] glance_api_insecure = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] glance_api_servers = ['http://192.168.122.186/image'] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] glance_api_ssl_compression = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] glance_ca_certificates_file = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] glance_catalog_info = image:glance:publicURL {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] glance_certfile = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] glance_keyfile = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] glance_num_retries = 3 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] glance_request_timeout = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] goodness_function = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] graceful_shutdown_timeout = 5 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] group_api_class = cinder.group.api.API {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] host = devstack {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] image_compress_on_upload = True {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] image_conversion_address_space_limit = 1 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] image_conversion_cpu_limit = 60 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] image_conversion_disable = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] image_upload_use_cinder_backend = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] image_upload_use_internal_tenant = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] image_volume_cache_enabled = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] image_volume_cache_max_count = 0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] image_volume_cache_max_size_gb = 0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] init_host_max_objects_retrieval = 0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] instance_format = [instance: %(uuid)s] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] iscsi_target_flags = {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] iscsi_write_cache = on {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] iser_helper = tgtadm {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] iser_ip_address = 192.168.122.186 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] iser_port = 3260 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] log_color = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] log_config_append = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] log_dir = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] log_file = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] log_options = True {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] log_rotate_interval = 1 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] log_rotate_interval_type = days {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] log_rotation_type = none {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] max_age = 0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] max_logfile_count = 30 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] max_logfile_size_mb = 200 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] max_over_subscription_ratio = 20.0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] message_reap_interval = 86400 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] message_ttl = 2592000 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] migration_create_volume_timeout_secs = 300 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] monkey_patch = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] monkey_patch_modules = [] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] my_ip = 192.168.122.186 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] no_snapshot_gb_quota = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] num_iser_scan_tries = 3 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] num_shell_tries = 3 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] num_volume_device_scan_tries = 3 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] nvmeof_conn_info_version = 1 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] nvmet_ns_id = 10 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] nvmet_port_id = 1 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] osapi_max_limit = 1000 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] osapi_volume_ext_list = [] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] osapi_volume_listen = 0.0.0.0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] osapi_volume_listen_port = 8776 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] osapi_volume_use_ssl = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] osapi_volume_workers = 2 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] per_volume_size_limit = -1 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] periodic_fuzzy_delay = 60 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] periodic_interval = 60 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] project_id_regex = [0-9a-f\-]+ {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] public_endpoint = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] publish_errors = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] quota_backup_gigabytes = 1000 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] quota_backups = 10 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] quota_gigabytes = 1000 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] quota_groups = 10 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] quota_snapshots = 10 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] quota_volumes = 10 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] rate_limit_burst = 0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] rate_limit_except_level = CRITICAL {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] rate_limit_interval = 0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] reinit_driver_count = 3 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] replication_device = **** {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] report_discard_supported = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] report_interval = 120 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] reservation_clean_interval = 86400 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] reservation_expire = 86400 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] reserved_image_namespaces = [] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] reserved_percentage = 0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] rpc_response_timeout = 120 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] run_external_periodic_tasks = True {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] scst_target_driver = iscsi {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] scst_target_iqn_name = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] service_down_time = 720 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] shell_completion = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] snapshot_name_template = snapshot-%s {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] split_loggers = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] state_path = /opt/stack/data/cinder {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] storage_availability_zone = nova {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] storage_protocol = iSCSI {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] syslog_log_facility = LOG_USER {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] target_helper = lioadm {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] target_ip_address = 192.168.122.186 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] target_port = 3260 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] target_protocol = iscsi {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] target_secondary_ip_addresses = [] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] trace_flags = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] transfer_api_class = cinder.transfer.api.API {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] transport_url = **** {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] until_refresh = 0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] use_chap_auth = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] use_default_quota_class = True {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] use_journal = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] use_json = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] use_multipath_for_image_xfer = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] use_stderr = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] use_syslog = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] verify_glance_signatures = enabled {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] volume_api_class = cinder.volume.api.API {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] volume_backend_name = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] volume_clear = zero {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] volume_clear_ionice = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] volume_clear_size = 0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] volume_copy_bps_limit = 0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] volume_dd_blocksize = 1M {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] volume_name_template = volume-%s {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] volume_service_inithost_offload = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] volume_usage_audit_period = month {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] zoning_mode = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_concurrency.disable_process_locking = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.admin_password = **** {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.admin_token = **** {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.admin_user = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.auth_admin_prefix = {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.auth_port = 35357 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.auth_protocol = https {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.auth_section = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.auth_type = password {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.auth_uri = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.auth_version = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.cache = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.certfile = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.delay_auth_decision = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.http_connect_timeout = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.identity_uri = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.include_service_catalog = True {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.insecure = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.interface = public {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.keyfile = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.memcache_password = {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.memcache_username = {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.region_name = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.service_token_roles_required = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.service_type = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.token_cache_time = 300 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.186/identity {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.backend = dogpile.cache.null {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.backend_argument = **** {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.backend_expiration_time = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.config_prefix = cache.oslo {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.debug_cache_backend = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.enable_retry_client = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.enable_socket_keepalive = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.enabled = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.enforce_fips_mode = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.expiration_time = 600 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.hashclient_retry_attempts = 2 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.memcache_dead_retry = 300 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.memcache_pool_maxsize = 10 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.memcache_sasl_enabled = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.password = **** {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.proxies = [] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.redis_db = 0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.redis_sentinel_service_name = mymaster {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.redis_server = localhost:6379 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.retry_attempts = 2 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.retry_delay = 0.0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.socket_keepalive_count = 1 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.socket_keepalive_idle = 1 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.socket_keepalive_interval = 1 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.socket_timeout = 1.0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.tls_allowed_ciphers = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.tls_cafile = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.tls_certfile = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.tls_enabled = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.tls_keyfile = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cache.username = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] coordination.backend_url = **** {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] database.asyncio_connection = **** {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] database.asyncio_slave_connection = **** {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] database.backend = sqlalchemy {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] database.connection = **** {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] database.connection_debug = 0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] database.connection_parameters = {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] database.connection_recycle_time = 3600 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] database.connection_trace = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] database.db_inc_retry_interval = True {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] database.db_max_retries = 20 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] database.db_max_retry_interval = 10 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] database.db_retry_interval = 1 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] database.max_overflow = 50 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] database.max_pool_size = 5 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] database.max_retries = 10 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] database.mysql_wsrep_sync_wait = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] database.pool_timeout = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] database.retry_interval = 10 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] database.slave_connection = **** {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] database.sqlite_synchronous = True {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] database.synchronous_reader = True {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] database.use_db_reconnect = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82406]: INFO cinder.volume.manager [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Starting volume driver QuobyteDriver (1.1.14) Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] profiler.connection_string = messaging:// {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] profiler.enabled = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] profiler.es_doc_type = notification {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] profiler.es_scroll_size = 10000 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] profiler.es_scroll_time = 2m {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] profiler.filter_error_trace = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] profiler.hmac_keys = **** {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] profiler.sentinel_service_name = mymaster {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] profiler.socket_timeout = 0.1 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] profiler.trace_requests = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] profiler.trace_sqlalchemy = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] profiler_jaeger.process_tags = {} {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] profiler_jaeger.service_name_prefix = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] profiler_otlp.service_name_prefix = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82406]: DEBUG cinder.volume.drivers.remotefs [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82406) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_policy.enforce_new_defaults = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: WARNING oslo_config.cfg [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_policy.enforce_scope = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_policy.policy_default_rule = default {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_policy.policy_file = policy.yaml {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_policy.remote_timeout = 60.0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] privsep_osbrick.group = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] privsep_osbrick.helper_command = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] privsep_osbrick.user = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cinder_sys_admin.group = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cinder_sys_admin.helper_command = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] cinder_sys_admin.user = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] service_user.auth_section = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] service_user.auth_type = password {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] service_user.cafile = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] service_user.certfile = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] service_user.collect_timing = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] service_user.insecure = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] service_user.keyfile = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] service_user.send_service_user_token = True {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] service_user.split_loggers = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] service_user.timeout = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] glance.auth_section = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] glance.auth_type = password {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] glance.certfile = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] glance.collect_timing = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] glance.insecure = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] glance.keyfile = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] glance.region_name = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] glance.split_loggers = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] glance.timeout = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.backend_availability_zone = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.chap_password = **** {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.chap_username = {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.disk_geometry = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.driver_client_cert = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.driver_client_cert_key = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.driver_data_namespace = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.driver_use_ssl = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.enable_unsupported_driver = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.extra_capabilities = {} {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.filter_function = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.goodness_function = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.iscsi_target_flags = {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.iscsi_write_cache = on {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.iser_helper = tgtadm {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.iser_ip_address = 192.168.122.186 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.iser_port = 3260 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.nas_host = {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.nas_login = admin {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.nas_mount_options = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.nas_password = **** {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.nas_private_key = {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.nas_share_path = {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.nas_ssh_port = 22 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.num_shell_tries = 3 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.nvmet_port_id = 1 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.quobyte_client_cfg = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.quobyte_volume_url = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.replication_device = **** {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.report_discard_supported = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.reserved_percentage = 0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.scst_target_driver = iscsi {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.scst_target_iqn_name = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.storage_protocol = iSCSI {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.target_helper = tgtadm {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.target_ip_address = 192.168.122.186 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.target_port = 3260 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.target_protocol = iscsi {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.trace_flags = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.unique_fqdn_network = True {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.use_chap_auth = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.volume_backend_name = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.volume_clear = zero {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.volume_clear_ionice = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.volume_clear_size = 0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_reports.file_event_handler = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_reports.log_dir = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.backend_availability_zone = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.backend_host = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.chap_password = **** {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.chap_username = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.chiscsi_conf = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.disk_geometry = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.driver_client_cert = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.driver_client_cert_key = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.driver_data_namespace = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.driver_use_ssl = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.extra_capabilities = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.filter_function = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.goodness_function = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.iscsi_target_flags = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.iscsi_write_cache = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.iser_helper = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.iser_ip_address = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.iser_port = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.iser_target_prefix = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.nas_host = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.nas_login = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.nas_mount_options = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.nas_password = **** {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.nas_private_key = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.nas_share_path = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.nas_ssh_port = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.num_shell_tries = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.nvmet_ns_id = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.nvmet_port_id = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.replication_device = **** {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.report_discard_supported = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.reserved_percentage = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.scst_target_driver = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.storage_protocol = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.target_helper = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.target_ip_address = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.target_port = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.target_prefix = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.target_protocol = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.trace_flags = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.unique_fqdn_network = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.use_chap_auth = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.volume_clear = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.volume_clear_ionice = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.volume_clear_size = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] QuobyteHD.volumes_dir = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.ssl = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.ssl_version = {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_notifications.driver = [] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_notifications.retry = -1 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] oslo_messaging_notifications.transport_url = **** {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] key_manager.fixed_key = **** {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] barbican.barbican_api_version = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] barbican.barbican_endpoint = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] barbican.barbican_endpoint_type = public {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] barbican.barbican_region_name = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] barbican.cafile = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] barbican.certfile = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] barbican.collect_timing = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] barbican.insecure = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] barbican.keyfile = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] barbican.number_of_retries = 60 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] barbican.retry_delay = 1 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] barbican.send_service_user_token = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] barbican.split_loggers = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] barbican.timeout = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] barbican.verify_ssl = True {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] barbican.verify_ssl_path = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] barbican_service_user.auth_section = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] barbican_service_user.auth_type = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] barbican_service_user.cafile = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] barbican_service_user.certfile = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] barbican_service_user.collect_timing = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] barbican_service_user.insecure = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] barbican_service_user.keyfile = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] barbican_service_user.split_loggers = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] barbican_service_user.timeout = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] vault.approle_role_id = **** {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] vault.approle_secret_id = **** {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] vault.kv_mountpoint = secret {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] vault.kv_path = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] vault.kv_version = 2 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] vault.namespace = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] vault.root_token_id = **** {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] vault.ssl_ca_crt_file = None {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] vault.timeout = 60.0 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] vault.use_ssl = False {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:40 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] ******************************************************************************** {{(pid=82285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 02 12:33:40 devstack cinder-volume[82406]: DEBUG cinder.volume.drivers.quobyte [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82406) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 02 12:33:40 devstack cinder-volume[82406]: WARNING cinder.volume.drivers.quobyte [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 02 12:33:40 devstack cinder-volume[82406]: WARNING cinder.volume.drivers.quobyte [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 02 12:33:40 devstack cinder-volume[82406]: DEBUG oslo_concurrency.processutils [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Running cmd (subprocess): mount.quobyte {{(pid=82406) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:33:40 devstack quobyte-client[82407]: Reading configuration file: /etc/quobyte/client.cfg Apr 02 12:33:40 devstack quobyte-client[82407]: Invalid parameters found, error: missing mount point. Apr 02 12:33:40 devstack quobyte-client[82407]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 02 12:33:40 devstack quobyte-client[82407]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 02 12:33:40 devstack cinder-volume[82406]: DEBUG oslo_concurrency.processutils [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] CMD "mount.quobyte" returned: 1 in 0.064s {{(pid=82406) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:33:40 devstack cinder-volume[82406]: DEBUG oslo_concurrency.lockutils [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82406) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:33:40 devstack cinder-volume[82406]: DEBUG oslo_concurrency.lockutils [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82406) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:33:40 devstack cinder-volume[82406]: DEBUG cinder.volume.drivers.quobyte [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82406) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:33:40 devstack cinder-volume[82406]: INFO cinder.volume.drivers.quobyte [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea ... Apr 02 12:33:40 devstack cinder-volume[82406]: DEBUG oslo_concurrency.processutils [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 -c /etc/quobyte/client-cinder.cfg {{(pid=82406) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:33:40 devstack sudo[82408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 -c /etc/quobyte/client-cinder.cfg Apr 02 12:33:40 devstack sudo[82408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:33:40 devstack sudo[82408]: pam_unix(sudo:session): session closed for user root Apr 02 12:33:40 devstack cinder-volume[82406]: DEBUG oslo_concurrency.processutils [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.521s {{(pid=82406) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:33:40 devstack cinder-volume[82406]: INFO cinder.volume.drivers.quobyte [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea succeeded Apr 02 12:33:40 devstack cinder-volume[82406]: DEBUG cinder.volume.drivers.quobyte [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82406) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:33:40 devstack cinder-volume[82406]: DEBUG oslo_concurrency.lockutils [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.528s {{(pid=82406) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:33:40 devstack cinder-volume[82406]: DEBUG oslo_concurrency.processutils [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82406) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:33:40 devstack sudo[82477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:33:40 devstack sudo[82477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:33:41 devstack sudo[82477]: pam_unix(sudo:session): session closed for user root Apr 02 12:33:41 devstack cinder-volume[82406]: DEBUG oslo_concurrency.processutils [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.473s {{(pid=82406) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:33:41 devstack cinder-volume[82406]: INFO cinder.volume.driver [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Driver hasn't implemented _init_vendor_properties() Apr 02 12:33:41 devstack cinder-volume[82406]: DEBUG cinder.volume.driver [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.740951538086, 'free_capacity_gb': 1775.740951538086, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82406) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 02 12:33:41 devstack cinder-volume[82406]: DEBUG oslo_db.sqlalchemy.engines [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82406) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 12:33:41 devstack cinder-volume[82406]: DEBUG dbcounter [-] [82406] Writer thread running {{(pid=82406) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 02 12:33:41 devstack cinder-volume[82406]: DEBUG cinder.db.sqlalchemy.api [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Building query based on filter {{(pid=82406) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 02 12:33:41 devstack cinder-volume[82406]: DEBUG cinder.image.image_utils [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82406) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 02 12:33:41 devstack cinder-volume[82406]: INFO cinder.keymgr.migration [None req-321fe825-127c-4361-a644-e997c5479e15 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 02 12:33:41 devstack cinder-volume[82406]: DEBUG oslo_concurrency.lockutils [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82406) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:33:41 devstack cinder-volume[82406]: DEBUG oslo_concurrency.lockutils [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82406) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:33:41 devstack cinder-volume[82406]: DEBUG cinder.volume.drivers.quobyte [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82406) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:33:41 devstack cinder-volume[82406]: DEBUG cinder.volume.drivers.quobyte [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82406) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:33:41 devstack cinder-volume[82406]: DEBUG oslo_concurrency.lockutils [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82406) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:33:41 devstack cinder-volume[82406]: DEBUG oslo_concurrency.processutils [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82406) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:33:41 devstack sudo[82486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:33:41 devstack sudo[82486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:33:41 devstack sudo[82486]: pam_unix(sudo:session): session closed for user root Apr 02 12:33:41 devstack cinder-volume[82406]: DEBUG oslo_concurrency.processutils [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.422s {{(pid=82406) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:33:41 devstack cinder-volume[82406]: DEBUG cinder.manager [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Notifying Schedulers of capabilities ... {{(pid=82406) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:33:41 devstack cinder-volume[82406]: INFO cinder.volume.manager [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Driver initialization completed successfully. Apr 02 12:33:41 devstack cinder-volume[82406]: INFO cinder.manager [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Initiating service 3 cleanup Apr 02 12:33:41 devstack cinder-volume[82406]: INFO cinder.manager [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Service 3 cleanup completed. Apr 02 12:33:41 devstack cinder-volume[82406]: DEBUG cinder.service [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Creating RPC server for service cinder-volume {{(pid=82406) start /opt/stack/cinder/cinder/service.py:231}} Apr 02 12:33:41 devstack cinder-volume[82406]: DEBUG cinder.service [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82406) start /opt/stack/cinder/cinder/service.py:237}} Apr 02 12:33:41 devstack cinder-volume[82406]: INFO cinder.volume.manager [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 02 12:33:41 devstack cinder-volume[82406]: DEBUG oslo_concurrency.lockutils [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82406) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:33:41 devstack cinder-volume[82406]: DEBUG oslo_concurrency.lockutils [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82406) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:33:41 devstack cinder-volume[82406]: DEBUG cinder.volume.drivers.quobyte [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82406) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:33:41 devstack cinder-volume[82406]: DEBUG cinder.volume.drivers.quobyte [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82406) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:33:41 devstack cinder-volume[82406]: DEBUG oslo_concurrency.lockutils [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82406) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:33:41 devstack cinder-volume[82406]: DEBUG oslo_concurrency.processutils [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82406) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:33:41 devstack sudo[82491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:33:41 devstack sudo[82491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:33:42 devstack sudo[82491]: pam_unix(sudo:session): session closed for user root Apr 02 12:33:42 devstack cinder-volume[82406]: DEBUG oslo_concurrency.processutils [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.466s {{(pid=82406) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:33:42 devstack cinder-volume[82406]: INFO cinder.volume.manager [None req-f29eac57-dfc5-4daf-8f4e-43eefe12f20f None None] Driver post RPC initialization completed successfully. Apr 02 12:33:45 devstack cinder-volume[82406]: DEBUG oslo_concurrency.lockutils [None req-135fc236-c185-43bb-a5f7-3c353a996c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82406) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:33:45 devstack cinder-volume[82406]: DEBUG oslo_concurrency.lockutils [None req-135fc236-c185-43bb-a5f7-3c353a996c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82406) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:33:45 devstack cinder-volume[82406]: DEBUG cinder.volume.drivers.quobyte [None req-135fc236-c185-43bb-a5f7-3c353a996c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82406) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:33:45 devstack cinder-volume[82406]: DEBUG cinder.volume.drivers.quobyte [None req-135fc236-c185-43bb-a5f7-3c353a996c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82406) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:33:45 devstack cinder-volume[82406]: DEBUG oslo_concurrency.lockutils [None req-135fc236-c185-43bb-a5f7-3c353a996c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82406) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:33:45 devstack cinder-volume[82406]: DEBUG oslo_concurrency.processutils [None req-135fc236-c185-43bb-a5f7-3c353a996c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82406) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:33:45 devstack sudo[82556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:33:45 devstack sudo[82556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:33:45 devstack sudo[82556]: pam_unix(sudo:session): session closed for user root Apr 02 12:33:45 devstack cinder-volume[82406]: DEBUG oslo_concurrency.processutils [None req-135fc236-c185-43bb-a5f7-3c353a996c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.407s {{(pid=82406) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:33:45 devstack cinder-volume[82406]: DEBUG cinder.manager [None req-135fc236-c185-43bb-a5f7-3c353a996c75 None None] Notifying Schedulers of capabilities ... {{(pid=82406) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:33:49 devstack cinder-volume[82285]: INFO oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] Caught SIGTERM, stopping children Apr 02 12:33:49 devstack cinder-volume[82285]: DEBUG oslo_concurrency.lockutils [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] Acquiring lock "singleton_lock" {{(pid=82285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 02 12:33:49 devstack cinder-volume[82285]: DEBUG oslo_concurrency.lockutils [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] Acquired lock "singleton_lock" {{(pid=82285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 02 12:33:49 devstack cinder-volume[82285]: DEBUG oslo_concurrency.lockutils [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] Releasing lock "singleton_lock" {{(pid=82285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 02 12:33:49 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] Stop services. {{(pid=82285) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 02 12:33:49 devstack cinder-volume[82285]: DEBUG oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] Killing children. {{(pid=82285) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 02 12:33:49 devstack cinder-volume[82285]: INFO oslo_service.backend._eventlet.service [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] Waiting on 1 children to exit Apr 02 12:33:52 devstack cinder-volume[82406]: DEBUG dbcounter [-] [82406] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82406) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:33:52 devstack cinder-volume[82406]: DEBUG dbcounter [-] [82406] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=82406) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:33:54 devstack cinder-volume[82406]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Apr 02 12:33:55 devstack cinder-volume[82406]: DEBUG oslo_concurrency.lockutils [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] Acquiring lock "singleton_lock" {{(pid=82406) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 02 12:33:55 devstack cinder-volume[82406]: DEBUG oslo_concurrency.lockutils [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] Acquired lock "singleton_lock" {{(pid=82406) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 02 12:33:55 devstack cinder-volume[82406]: DEBUG oslo_concurrency.lockutils [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] Releasing lock "singleton_lock" {{(pid=82406) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 02 12:33:55 devstack cinder-volume[82406]: WARNING amqp [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 02 12:33:55 devstack cinder-volume[82406]: WARNING amqp [None req-bf45baa6-c1dd-495d-a0ca-e4c8db2b647a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 02 12:33:56 devstack cinder-volume[82688]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82688) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 02 12:33:56 devstack cinder-volume[82688]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82688) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 02 12:33:56 devstack cinder-volume[82688]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82688) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 02 12:33:56 devstack cinder-volume[82688]: INFO dbcounter [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] Registered counter for database cinder Apr 02 12:33:56 devstack cinder-volume[82688]: DEBUG oslo_db.sqlalchemy.engines [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82688) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG dbcounter [-] [82688] Writer thread running {{(pid=82688) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 02 12:33:57 devstack cinder-volume[82688]: INFO cinder.rpc [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 02 12:33:57 devstack cinder-volume[82688]: INFO cinder.rpc [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_db.sqlalchemy.engines [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82688) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 12:33:57 devstack cinder-volume[82688]: INFO cinder.volume.manager [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] Determined volume DB was empty at startup. Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG cinder.volume.manager [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82688) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 02 12:33:57 devstack cinder-volume[82688]: WARNING stevedore.named [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 02 12:33:57 devstack cinder-volume[82688]: WARNING castellan.key_manager [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 02 12:33:57 devstack cinder-volume[82688]: WARNING cinder.keymgr.conf_key_mgr [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 02 12:33:57 devstack cinder-volume[82688]: INFO cinder.volume.manager [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_db.sqlalchemy.engines [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82688) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 12:33:57 devstack cinder-volume[82688]: INFO oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] Starting 1 workers Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] Started child 82819 {{(pid=82688) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] Full set of CONF: {{(pid=82688) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] ******************************************************************************** {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] Configuration options gathered from: {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] ================================================================================ {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] allow_availability_zone_fallback = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] allow_compression_on_image_upload = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82819]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] allowed_direct_url_schemes = [] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] api_rate_limit = True {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] auth_strategy = keystone {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_availability_zone = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_host = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_name = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_stats_polling_interval = 60 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backup_api_class = cinder.backup.api.API {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backup_name_template = backup-%s {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backup_use_same_host = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backup_use_temp_snapshot = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] chap_password = **** {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] chap_username = {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cinder_internal_tenant_project_id = a19435a9ba1346f8ba6fcd00394e5fa6 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cinder_internal_tenant_user_id = 12d6a4f6ec3b4e278075b3688645a321 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cluster = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] compression_format = gzip {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] compute_api_class = cinder.compute.nova.API {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] config_dir = [] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] config_source = [] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] control_exchange = openstack {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] debug = True {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] default_availability_zone = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] default_group_type = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] default_volume_type = QuobyteHD {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] disk_geometry = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] driver_client_cert = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] driver_client_cert_key = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] driver_data_namespace = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] driver_ssl_cert_path = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] driver_ssl_cert_verify = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] driver_use_ssl = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] enable_new_services = True {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] enable_unsupported_driver = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] enabled_backends = ['QuobyteHD'] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] enforce_multipath_for_image_xfer = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] filter_function = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] glance_api_insecure = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] glance_api_servers = ['http://192.168.122.186/image'] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] glance_api_ssl_compression = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] glance_ca_certificates_file = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] glance_catalog_info = image:glance:publicURL {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] glance_certfile = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] glance_keyfile = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] glance_num_retries = 3 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] glance_request_timeout = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] goodness_function = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] graceful_shutdown_timeout = 5 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] group_api_class = cinder.group.api.API {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] host = devstack {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] image_compress_on_upload = True {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] image_conversion_address_space_limit = 1 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] image_conversion_cpu_limit = 60 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] image_conversion_disable = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] image_upload_use_cinder_backend = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] image_upload_use_internal_tenant = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] image_volume_cache_enabled = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] image_volume_cache_max_count = 0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] image_volume_cache_max_size_gb = 0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] init_host_max_objects_retrieval = 0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] instance_format = [instance: %(uuid)s] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] iscsi_target_flags = {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] iscsi_write_cache = on {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] iser_helper = tgtadm {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] iser_ip_address = 192.168.122.186 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] iser_port = 3260 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] log_color = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] log_config_append = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] log_dir = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] log_file = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] log_options = True {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] log_rotate_interval = 1 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] log_rotate_interval_type = days {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] log_rotation_type = none {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] max_age = 0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] max_logfile_count = 30 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] max_logfile_size_mb = 200 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] max_over_subscription_ratio = 20.0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] message_reap_interval = 86400 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] message_ttl = 2592000 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] migration_create_volume_timeout_secs = 300 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] monkey_patch = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] monkey_patch_modules = [] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] my_ip = 192.168.122.186 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] no_snapshot_gb_quota = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] num_iser_scan_tries = 3 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] num_shell_tries = 3 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] num_volume_device_scan_tries = 3 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] nvmeof_conn_info_version = 1 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] nvmet_ns_id = 10 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] nvmet_port_id = 1 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] osapi_max_limit = 1000 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] osapi_volume_ext_list = [] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] osapi_volume_listen_port = 8776 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] osapi_volume_use_ssl = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] osapi_volume_workers = 2 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] per_volume_size_limit = -1 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] periodic_fuzzy_delay = 60 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] periodic_interval = 60 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] public_endpoint = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] publish_errors = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] quota_backup_gigabytes = 1000 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] quota_backups = 10 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] quota_gigabytes = 1000 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] quota_groups = 10 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] quota_snapshots = 10 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] quota_volumes = 10 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] rate_limit_burst = 0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] rate_limit_except_level = CRITICAL {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] rate_limit_interval = 0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] reinit_driver_count = 3 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] replication_device = **** {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] report_discard_supported = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] report_interval = 120 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] reservation_clean_interval = 86400 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] reservation_expire = 86400 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] reserved_image_namespaces = [] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] reserved_percentage = 0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82819) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] rpc_response_timeout = 120 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] run_external_periodic_tasks = True {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] scst_target_driver = iscsi {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] scst_target_iqn_name = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] service_down_time = 720 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] shell_completion = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] snapshot_name_template = snapshot-%s {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] split_loggers = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] state_path = /opt/stack/data/cinder {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] storage_availability_zone = nova {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] storage_protocol = iSCSI {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] syslog_log_facility = LOG_USER {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] target_helper = lioadm {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] target_ip_address = 192.168.122.186 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] target_port = 3260 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] target_protocol = iscsi {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] target_secondary_ip_addresses = [] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] trace_flags = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] transport_url = **** {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] until_refresh = 0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] use_chap_auth = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] use_default_quota_class = True {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] use_journal = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] use_json = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] use_multipath_for_image_xfer = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] use_stderr = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] use_syslog = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] verify_glance_signatures = enabled {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] volume_api_class = cinder.volume.api.API {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] volume_backend_name = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] volume_clear = zero {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] volume_clear_ionice = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] volume_clear_size = 0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] volume_copy_bps_limit = 0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] volume_dd_blocksize = 1M {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] volume_name_template = volume-%s {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] volume_service_inithost_offload = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] volume_usage_audit_period = month {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] zoning_mode = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_concurrency.disable_process_locking = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.admin_password = **** {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.admin_token = **** {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.admin_user = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.auth_port = 35357 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.auth_protocol = https {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.auth_section = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.auth_type = password {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.auth_uri = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.auth_version = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.cache = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.certfile = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.identity_uri = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.include_service_catalog = True {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.insecure = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.interface = public {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.keyfile = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.memcache_password = {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.memcache_username = {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.region_name = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.service_type = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.186/identity {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.backend = dogpile.cache.null {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.backend_argument = **** {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.backend_expiration_time = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.config_prefix = cache.oslo {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.debug_cache_backend = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.enable_retry_client = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.enable_socket_keepalive = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.enabled = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.enforce_fips_mode = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.expiration_time = 600 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.hashclient_retry_attempts = 2 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.memcache_dead_retry = 300 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.memcache_pool_maxsize = 10 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.memcache_sasl_enabled = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.password = **** {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.proxies = [] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.redis_db = 0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.redis_server = localhost:6379 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.retry_attempts = 2 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.retry_delay = 0.0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.socket_keepalive_count = 1 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.socket_keepalive_idle = 1 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.socket_keepalive_interval = 1 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.socket_timeout = 1.0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.tls_allowed_ciphers = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.tls_cafile = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.tls_certfile = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.tls_enabled = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.tls_keyfile = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cache.username = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] coordination.backend_url = **** {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] database.asyncio_connection = **** {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] database.asyncio_slave_connection = **** {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] database.backend = sqlalchemy {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] database.connection = **** {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] database.connection_debug = 0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] database.connection_parameters = {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] database.connection_recycle_time = 3600 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] database.connection_trace = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] database.db_inc_retry_interval = True {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] database.db_max_retries = 20 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] database.db_max_retry_interval = 10 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] database.db_retry_interval = 1 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] database.max_overflow = 50 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] database.max_pool_size = 5 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] database.max_retries = 10 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] database.mysql_wsrep_sync_wait = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] database.pool_timeout = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] database.retry_interval = 10 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] database.slave_connection = **** {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] database.sqlite_synchronous = True {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] database.synchronous_reader = True {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] database.use_db_reconnect = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] profiler.connection_string = messaging:// {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] profiler.enabled = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] profiler.es_doc_type = notification {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] profiler.es_scroll_size = 10000 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] profiler.es_scroll_time = 2m {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] profiler.filter_error_trace = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] profiler.hmac_keys = **** {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] profiler.sentinel_service_name = mymaster {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] profiler.socket_timeout = 0.1 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] profiler.trace_requests = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] profiler.trace_sqlalchemy = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] profiler_jaeger.process_tags = {} {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] profiler_jaeger.service_name_prefix = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] profiler_otlp.service_name_prefix = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_policy.enforce_new_defaults = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: WARNING oslo_config.cfg [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_policy.enforce_scope = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_policy.policy_default_rule = default {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_policy.policy_file = policy.yaml {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] privsep_osbrick.group = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] privsep_osbrick.helper_command = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] privsep_osbrick.user = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cinder_sys_admin.group = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cinder_sys_admin.helper_command = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] cinder_sys_admin.user = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] service_user.auth_section = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] service_user.auth_type = password {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] service_user.cafile = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] service_user.certfile = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] service_user.collect_timing = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] service_user.insecure = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82819) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] service_user.keyfile = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.quobyte [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] service_user.send_service_user_token = True {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.quobyte [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] service_user.split_loggers = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] service_user.timeout = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] glance.auth_section = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] glance.auth_type = password {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] glance.certfile = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] glance.collect_timing = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] glance.insecure = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Running cmd (subprocess): mount.quobyte {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] glance.keyfile = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] glance.region_name = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] glance.split_loggers = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] glance.timeout = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.backend_availability_zone = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.chap_password = **** {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.chap_username = {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.disk_geometry = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.driver_client_cert = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.driver_client_cert_key = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.driver_data_namespace = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.driver_use_ssl = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.extra_capabilities = {} {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.filter_function = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.goodness_function = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.iscsi_target_flags = {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.iscsi_write_cache = on {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.iser_helper = tgtadm {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.iser_ip_address = 192.168.122.186 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.iser_port = 3260 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.nas_host = {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.nas_login = admin {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.nas_mount_options = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.nas_password = **** {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.nas_private_key = {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.nas_share_path = {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.num_shell_tries = 3 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.quobyte_volume_url = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.replication_device = **** {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.report_discard_supported = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.reserved_percentage = 0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.target_helper = tgtadm {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.target_ip_address = 192.168.122.186 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.target_port = 3260 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.target_protocol = iscsi {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.trace_flags = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.unique_fqdn_network = True {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.use_chap_auth = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.volume_backend_name = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.volume_clear = zero {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.volume_clear_ionice = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.volume_clear_size = 0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_reports.file_event_handler = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_reports.log_dir = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.backend_availability_zone = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.backend_host = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.chap_password = **** {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.chap_username = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.chiscsi_conf = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.disk_geometry = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.driver_client_cert = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.driver_data_namespace = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.driver_use_ssl = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.extra_capabilities = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.filter_function = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.goodness_function = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.iser_helper = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.iser_ip_address = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.iser_port = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.iser_target_prefix = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.nas_host = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.nas_login = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.nas_mount_options = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.nas_password = **** {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.nas_private_key = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.nas_share_path = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.nas_ssh_port = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.num_shell_tries = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.nvmet_port_id = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.replication_device = **** {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.report_discard_supported = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.reserved_percentage = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.scst_target_driver = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.storage_protocol = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.target_helper = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.target_ip_address = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.target_port = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.target_prefix = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.target_protocol = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.trace_flags = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.use_chap_auth = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.volume_clear = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.volume_clear_size = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] QuobyteHD.volumes_dir = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.ssl = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_notifications.driver = [] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_notifications.retry = -1 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] key_manager.fixed_key = **** {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] barbican.barbican_api_version = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] barbican.barbican_endpoint = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] barbican.barbican_endpoint_type = public {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] barbican.barbican_region_name = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] barbican.cafile = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] barbican.certfile = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] barbican.collect_timing = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] barbican.insecure = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] barbican.keyfile = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] barbican.number_of_retries = 60 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] barbican.retry_delay = 1 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] barbican.send_service_user_token = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] barbican.split_loggers = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] barbican.timeout = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] barbican.verify_ssl = True {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] barbican.verify_ssl_path = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] barbican_service_user.auth_section = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] barbican_service_user.auth_type = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] barbican_service_user.cafile = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] barbican_service_user.certfile = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] barbican_service_user.collect_timing = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] barbican_service_user.insecure = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] barbican_service_user.keyfile = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] barbican_service_user.split_loggers = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] barbican_service_user.timeout = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] vault.approle_role_id = **** {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] vault.approle_secret_id = **** {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] vault.kv_mountpoint = secret {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] vault.kv_path = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] vault.kv_version = 2 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] vault.namespace = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] vault.root_token_id = **** {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] vault.ssl_ca_crt_file = None {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] vault.timeout = 60.0 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] vault.use_ssl = False {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 12:33:57 devstack cinder-volume[82688]: DEBUG oslo_service.backend._eventlet.service [None req-a2371d83-df94-41cb-b45e-3498bd968a67 None None] ******************************************************************************** {{(pid=82688) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 02 12:33:57 devstack quobyte-client[82821]: Reading configuration file: /etc/quobyte/client.cfg Apr 02 12:33:57 devstack quobyte-client[82821]: Invalid parameters found, error: missing mount point. Apr 02 12:33:57 devstack quobyte-client[82821]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 02 12:33:57 devstack quobyte-client[82821]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 02 12:33:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] CMD "mount.quobyte" returned: 1 in 0.079s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:33:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:33:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:33:57 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:33:57 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:33:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:33:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:33:57 devstack sudo[82822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:33:57 devstack sudo[82822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:33:57 devstack sudo[82822]: pam_unix(sudo:session): session closed for user root Apr 02 12:33:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.432s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:33:57 devstack cinder-volume[82819]: INFO cinder.volume.driver [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Driver hasn't implemented _init_vendor_properties() Apr 02 12:33:57 devstack cinder-volume[82819]: DEBUG cinder.volume.driver [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.740951538086, 'free_capacity_gb': 1775.740951538086, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82819) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 02 12:33:57 devstack cinder-volume[82819]: DEBUG oslo_db.sqlalchemy.engines [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82819) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 12:33:57 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writer thread running {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 02 12:33:57 devstack cinder-volume[82819]: DEBUG cinder.db.sqlalchemy.api [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Building query based on filter {{(pid=82819) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 02 12:33:57 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82819) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 02 12:33:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:33:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:33:58 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:33:58 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:33:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:33:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:33:58 devstack cinder-volume[82819]: INFO cinder.keymgr.migration [None req-6690dead-4795-4fa8-9270-5c258d9c1a9f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 02 12:33:58 devstack sudo[82862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:33:58 devstack sudo[82862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:33:58 devstack sudo[82862]: pam_unix(sudo:session): session closed for user root Apr 02 12:33:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.447s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:33:58 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:33:58 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Driver initialization completed successfully. Apr 02 12:33:58 devstack cinder-volume[82819]: INFO cinder.manager [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Initiating service 3 cleanup Apr 02 12:33:58 devstack cinder-volume[82819]: INFO cinder.manager [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Service 3 cleanup completed. Apr 02 12:33:58 devstack cinder-volume[82819]: DEBUG cinder.service [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Creating RPC server for service cinder-volume {{(pid=82819) start /opt/stack/cinder/cinder/service.py:231}} Apr 02 12:33:58 devstack cinder-volume[82819]: DEBUG cinder.service [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82819) start /opt/stack/cinder/cinder/service.py:237}} Apr 02 12:33:58 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 02 12:33:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:33:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:33:58 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:33:58 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:33:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:33:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:33:58 devstack sudo[82906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:33:58 devstack sudo[82906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:33:59 devstack sudo[82906]: pam_unix(sudo:session): session closed for user root Apr 02 12:33:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.490s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:33:59 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-02b4fef4-1b73-4e80-b5b3-b862c742dbf0 None None] Driver post RPC initialization completed successfully. Apr 02 12:34:07 devstack cinder-volume[82688]: DEBUG dbcounter [-] [82688] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82688) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:34:08 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:SELECT=3 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:34:09 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:34:18 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-97ffaa01-b3f6-4bd5-8b81-a2e936c8f35d tempest-BackendsCapabilitiesAdminTestsJSON-862166160 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.740951538086, 'free_capacity_gb': 1775.740951538086, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82819) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 02 12:34:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-114251a0-7be8-495d-8d7d-ed1662946c7d tempest-BackendsCapabilitiesAdminTestsJSON-862166160 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.740951538086, 'free_capacity_gb': 1775.740951538086, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82819) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 02 12:34:54 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-c2de4647-55cc-4e1f-962a-1417da7770f6 tempest-GroupsV314Test-2110680073 None] Group tempest-GroupsV314Test-Group-2100713627: creating Apr 02 12:34:54 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-c2de4647-55cc-4e1f-962a-1417da7770f6 tempest-GroupsV314Test-2110680073 None] Group tempest-GroupsV314Test-Group-2100713627: created successfully Apr 02 12:34:54 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-c2de4647-55cc-4e1f-962a-1417da7770f6 tempest-GroupsV314Test-2110680073 None] Create group completed successfully. Apr 02 12:34:54 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-f2ddbc27-8304-4ffe-9c26-48ebd26a5398 tempest-GroupSnapshotsV319Test-1741884566 None] Group tempest-GroupSnapshotsV319Test-Group-1467335444: creating Apr 02 12:34:54 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-f2ddbc27-8304-4ffe-9c26-48ebd26a5398 tempest-GroupSnapshotsV319Test-1741884566 None] Group tempest-GroupSnapshotsV319Test-Group-1467335444: created successfully Apr 02 12:34:54 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-f2ddbc27-8304-4ffe-9c26-48ebd26a5398 tempest-GroupSnapshotsV319Test-1741884566 None] Create group completed successfully. Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Flow 'volume_create_manager' (5d41d15b-9846-4245-b55b-c4c8ea78a55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (403680fc-863b-4620-9b94-ecf41e3f4fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (403680fc-863b-4620-9b94-ecf41e3f4fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-511716223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f3b75be6-051a-4545-a091-803d3fcca277,host='devstack@QuobyteHD#QuobyteHD',id=6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a34c7b4fc56547e1a5916653765aa5ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:34:55Z,use_quota=True,user_id='bf3fcad6738a4892a2b6c6b827c56edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b2fc63c-36ac-44ce-9c96-f876964f6f7c),volume_type_id=6b2fc63c-36ac-44ce-9c96-f876964f6f7c)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87aa3da7-32c2-473e-bc5d-8a53303cfe67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87aa3da7-32c2-473e-bc5d-8a53303cfe67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff69aaec-c6ab-4177-8647-8f3c874d0221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff69aaec-c6ab-4177-8647-8f3c874d0221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3', 'volume_name': 'volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6c9d94-2310-49e3-b3fa-be2ba4365f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6c9d94-2310-49e3-b3fa-be2ba4365f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (057e1928-13e8-439a-9f19-b16e44288bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:34:55 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Volume 6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3', 'volume_size': 1} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f3b75be6-051a-4545-a091-803d3fcca277,created_at=2026-04-02T10:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-511716223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f3b75be6-051a-4545-a091-803d3fcca277,host='devstack@QuobyteHD#QuobyteHD',id=6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a34c7b4fc56547e1a5916653765aa5ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:34:55Z,use_quota=True,user_id='bf3fcad6738a4892a2b6c6b827c56edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b2fc63c-36ac-44ce-9c96-f876964f6f7c),volume_type_id=6b2fc63c-36ac-44ce-9c96-f876964f6f7c)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Creating volume 6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:34:55 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:34:55 devstack sudo[83166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3 1073741824 Apr 02 12:34:55 devstack sudo[83166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Flow 'volume_create_manager' (eb2d9ea9-05f3-405b-902c-c646fb6d476c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639342e4-7473-4f3f-a7a1-37ac5be28c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639342e4-7473-4f3f-a7a1-37ac5be28c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-478782160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c21f3b00-c000-4df5-9e4e-b6b78f1d44ce,host='devstack@QuobyteHD#QuobyteHD',id=f51a100b-1b3a-4975-9cce-fd745bbd9aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81352fcd6b284463890cab0c3bd29375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:34:56Z,use_quota=True,user_id='5dafde622ab64cc1bbc21cb1edbde16d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d7e8165-68e9-4b77-bee9-5cc2a041df68),volume_type_id=7d7e8165-68e9-4b77-bee9-5cc2a041df68)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c0346b-63c2-4e27-93ba-e9da55e05468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c0346b-63c2-4e27-93ba-e9da55e05468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d02752fd-2f55-4351-85a9-254cd20d88fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d02752fd-2f55-4351-85a9-254cd20d88fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f51a100b-1b3a-4975-9cce-fd745bbd9aab', 'volume_name': 'volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279075ea-bf42-4358-bc5e-00e74f9db8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279075ea-bf42-4358-bc5e-00e74f9db8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f2c33d-eca4-4016-92e5-88493a5950c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:34:55 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Volume f51a100b-1b3a-4975-9cce-fd745bbd9aab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab', 'volume_size': 1} Apr 02 12:34:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:34:56 devstack sudo[83166]: pam_unix(sudo:session): session closed for user root Apr 02 12:34:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3 1073741824" returned: 0 in 0.715s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:34:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:34:56 devstack sudo[83486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3 Apr 02 12:34:56 devstack sudo[83486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:34:56 devstack sudo[83486]: pam_unix(sudo:session): session closed for user root Apr 02 12:34:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3" returned: 0 in 0.575s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:34:56 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:34:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:34:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.254s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:34:56 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c21f3b00-c000-4df5-9e4e-b6b78f1d44ce,created_at=2026-04-02T10:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-478782160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c21f3b00-c000-4df5-9e4e-b6b78f1d44ce,host='devstack@QuobyteHD#QuobyteHD',id=f51a100b-1b3a-4975-9cce-fd745bbd9aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81352fcd6b284463890cab0c3bd29375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:34:56Z,use_quota=True,user_id='5dafde622ab64cc1bbc21cb1edbde16d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d7e8165-68e9-4b77-bee9-5cc2a041df68),volume_type_id=7d7e8165-68e9-4b77-bee9-5cc2a041df68)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:34:56 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Creating volume f51a100b-1b3a-4975-9cce-fd745bbd9aab {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:34:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:34:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:34:56 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:34:56 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:34:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:34:56 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:34:56 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:34:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:34:56 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (057e1928-13e8-439a-9f19-b16e44288bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:34:56 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f6991f-fd3e-4d56-a284-3a61c4cd9ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:34:57 devstack sudo[83514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab 1073741824 Apr 02 12:34:57 devstack sudo[83514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:34:57 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Volume volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3 (6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3): created successfully Apr 02 12:34:57 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f6991f-fd3e-4d56-a284-3a61c4cd9ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:34:57 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Flow 'volume_create_manager' (5d41d15b-9846-4245-b55b-c4c8ea78a55c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:34:57 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-166b1ede-80b1-4623-a5ed-228fd6a1c4c0 tempest-GroupSnapshotsV319Test-1741884566 None] Created volume successfully. Apr 02 12:34:58 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-971aaeec-e133-41e1-a114-f316799d5a0e tempest-GroupSnapshotsV319Test-1741884566 None] GroupSnapshot 1736f083-903e-4129-a19b-56119f9b94fa: creating. Apr 02 12:34:58 devstack sudo[83514]: pam_unix(sudo:session): session closed for user root Apr 02 12:34:58 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-971aaeec-e133-41e1-a114-f316799d5a0e tempest-GroupSnapshotsV319Test-1741884566 None] Group snapshot 1736f083-903e-4129-a19b-56119f9b94fa: creating. {{(pid=82819) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 02 12:34:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab 1073741824" returned: 0 in 1.167s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:34:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-971aaeec-e133-41e1-a114-f316799d5a0e tempest-GroupSnapshotsV319Test-1741884566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:34:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:34:58 devstack sudo[83529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab Apr 02 12:34:58 devstack sudo[83529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:34:58 devstack sudo[83529]: pam_unix(sudo:session): session closed for user root Apr 02 12:34:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab" returned: 0 in 0.572s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:34:58 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:34:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:34:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-971aaeec-e133-41e1-a114-f316799d5a0e tempest-GroupSnapshotsV319Test-1741884566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.590s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:34:58 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-971aaeec-e133-41e1-a114-f316799d5a0e tempest-GroupSnapshotsV319Test-1741884566 None] Creating offline snapshot 12a31d7e-ba6d-4ef6-96f7-2b771d1b54ef of volume 6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3 {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:34:58 devstack cinder-volume[82819]: INFO oslo.privsep.daemon [None req-971aaeec-e133-41e1-a114-f316799d5a0e tempest-GroupSnapshotsV319Test-1741884566 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpkm4xufy_/privsep.sock'] Apr 02 12:34:58 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f2c33d-eca4-4016-92e5-88493a5950c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:34:58 devstack sudo[83534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpkm4xufy_/privsep.sock Apr 02 12:34:58 devstack sudo[83534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:34:58 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8429801-68c5-40cd-90fa-f39b977873da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:34:58 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Volume volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab (f51a100b-1b3a-4975-9cce-fd745bbd9aab): created successfully Apr 02 12:34:58 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8429801-68c5-40cd-90fa-f39b977873da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:34:58 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Flow 'volume_create_manager' (eb2d9ea9-05f3-405b-902c-c646fb6d476c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:34:58 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-c84b5d60-0f82-4089-a8f9-39c270b040d6 tempest-GroupsV314Test-2110680073 None] Created volume successfully. Apr 02 12:34:59 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:34:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Flow 'volume_create_manager' (2207f8f5-59bb-4967-91f5-f748c15f6cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:34:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f633a63c-c054-4948-bba8-09af658748e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:34:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f633a63c-c054-4948-bba8-09af658748e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1231989214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef471137-e0c4-4a6e-b705-983da6664bff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77ac22431bc34fa69231a1776bd489d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:35:00Z,use_quota=True,user_id='c414f2ce193c49c39b78af98104203cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:34:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b48627ae-d8c7-4560-8ee5-2e2412fcea4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:34:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b48627ae-d8c7-4560-8ee5-2e2412fcea4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:34:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5cb3f16-d8d1-43ed-9218-48821a1dd4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:34:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5cb3f16-d8d1-43ed-9218-48821a1dd4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef471137-e0c4-4a6e-b705-983da6664bff', 'volume_name': 'volume-ef471137-e0c4-4a6e-b705-983da6664bff', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:34:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (113bbad4-349c-4ea0-b512-b72672c0c3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:34:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (113bbad4-349c-4ea0-b512-b72672c0c3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:34:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7dda091-5bd7-4b90-bfdd-66099c785ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:34:59 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Volume ef471137-e0c4-4a6e-b705-983da6664bff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef471137-e0c4-4a6e-b705-983da6664bff', 'volume_size': 1} Apr 02 12:34:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:00 devstack sudo[83534]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:00 devstack cinder-volume[82819]: INFO oslo.privsep.daemon [None req-971aaeec-e133-41e1-a114-f316799d5a0e tempest-GroupSnapshotsV319Test-1741884566 None] Spawned new privsep daemon via rootwrap Apr 02 12:35:00 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [None req-971aaeec-e133-41e1-a114-f316799d5a0e tempest-GroupSnapshotsV319Test-1741884566 None] Accepted privsep connection to /tmp/tmpkm4xufy_/privsep.sock {{(pid=82819) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 02 12:35:00 devstack cinder-volume[82819]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 02 12:35:00 devstack cinder-volume[82819]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 02 12:35:00 devstack cinder-volume[82819]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 02 12:35:00 devstack cinder-volume[82819]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83541 Apr 02 12:35:00 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4c1def-c86b-4e85-9c83-5df1b7ff094c]: (2,) {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:35:00 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e583aae5-632f-45f3-8f5a-598dda37e455]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:35:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-971aaeec-e133-41e1-a114-f316799d5a0e tempest-GroupSnapshotsV319Test-1741884566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:00 devstack sudo[83543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3 Apr 02 12:35:00 devstack sudo[83543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:01 devstack sudo[83543]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-971aaeec-e133-41e1-a114-f316799d5a0e tempest-GroupSnapshotsV319Test-1741884566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3" returned: 0 in 0.868s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-971aaeec-e133-41e1-a114-f316799d5a0e tempest-GroupSnapshotsV319Test-1741884566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3.12a31d7e-ba6d-4ef6-96f7-2b771d1b54ef 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:01 devstack sudo[83548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3.12a31d7e-ba6d-4ef6-96f7-2b771d1b54ef 1G Apr 02 12:35:01 devstack sudo[83548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:02 devstack sudo[83548]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-971aaeec-e133-41e1-a114-f316799d5a0e tempest-GroupSnapshotsV319Test-1741884566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3.12a31d7e-ba6d-4ef6-96f7-2b771d1b54ef 1G" returned: 0 in 0.756s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-971aaeec-e133-41e1-a114-f316799d5a0e tempest-GroupSnapshotsV319Test-1741884566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3.12a31d7e-ba6d-4ef6-96f7-2b771d1b54ef {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:02 devstack sudo[83553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3.12a31d7e-ba6d-4ef6-96f7-2b771d1b54ef Apr 02 12:35:02 devstack sudo[83553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:03 devstack sudo[83553]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-971aaeec-e133-41e1-a114-f316799d5a0e tempest-GroupSnapshotsV319Test-1741884566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3.12a31d7e-ba6d-4ef6-96f7-2b771d1b54ef" returned: 0 in 0.893s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:03 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-971aaeec-e133-41e1-a114-f316799d5a0e tempest-GroupSnapshotsV319Test-1741884566 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3.12a31d7e-ba6d-4ef6-96f7-2b771d1b54ef is being set with open permissions: ugo+rw: NotImplementedError Apr 02 12:35:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-971aaeec-e133-41e1-a114-f316799d5a0e tempest-GroupSnapshotsV319Test-1741884566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3.12a31d7e-ba6d-4ef6-96f7-2b771d1b54ef {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:03 devstack sudo[83559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3.12a31d7e-ba6d-4ef6-96f7-2b771d1b54ef Apr 02 12:35:03 devstack sudo[83559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:03 devstack sudo[83559]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-971aaeec-e133-41e1-a114-f316799d5a0e tempest-GroupSnapshotsV319Test-1741884566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3.12a31d7e-ba6d-4ef6-96f7-2b771d1b54ef" returned: 0 in 0.519s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-971aaeec-e133-41e1-a114-f316799d5a0e tempest-GroupSnapshotsV319Test-1741884566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:03 devstack sudo[83562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3.info Apr 02 12:35:03 devstack sudo[83562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:04 devstack sudo[83562]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-971aaeec-e133-41e1-a114-f316799d5a0e tempest-GroupSnapshotsV319Test-1741884566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3.info" returned: 0 in 0.542s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:04 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-971aaeec-e133-41e1-a114-f316799d5a0e tempest-GroupSnapshotsV319Test-1741884566 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3.info is being set with open permissions: ugo+rw: NotImplementedError Apr 02 12:35:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-971aaeec-e133-41e1-a114-f316799d5a0e tempest-GroupSnapshotsV319Test-1741884566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:04 devstack sudo[83565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3.info Apr 02 12:35:04 devstack sudo[83565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:04 devstack sudo[83565]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-971aaeec-e133-41e1-a114-f316799d5a0e tempest-GroupSnapshotsV319Test-1741884566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3.info" returned: 0 in 0.599s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-971aaeec-e133-41e1-a114-f316799d5a0e tempest-GroupSnapshotsV319Test-1741884566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.111s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.011s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:04 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1231989214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef471137-e0c4-4a6e-b705-983da6664bff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77ac22431bc34fa69231a1776bd489d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:35:00Z,use_quota=True,user_id='c414f2ce193c49c39b78af98104203cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:35:04 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Creating volume ef471137-e0c4-4a6e-b705-983da6664bff {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:35:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:04 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:35:04 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:35:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:04 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:35:04 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:35:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ef471137-e0c4-4a6e-b705-983da6664bff 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:04 devstack sudo[83583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ef471137-e0c4-4a6e-b705-983da6664bff 1073741824 Apr 02 12:35:04 devstack sudo[83583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:04 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-971aaeec-e133-41e1-a114-f316799d5a0e tempest-GroupSnapshotsV319Test-1741884566 None] group_snapshot 1736f083-903e-4129-a19b-56119f9b94fa: created successfully Apr 02 12:35:05 devstack sudo[83583]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ef471137-e0c4-4a6e-b705-983da6664bff 1073741824" returned: 0 in 0.802s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ef471137-e0c4-4a6e-b705-983da6664bff {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:05 devstack sudo[83600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ef471137-e0c4-4a6e-b705-983da6664bff Apr 02 12:35:05 devstack sudo[83600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:06 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-99bf3dcb-981e-4900-8a82-fb785af0e7d3 tempest-GroupSnapshotsV319Test-1741884566 None] group_snapshot 1736f083-903e-4129-a19b-56119f9b94fa: deleting Apr 02 12:35:06 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-99bf3dcb-981e-4900-8a82-fb785af0e7d3 tempest-GroupSnapshotsV319Test-1741884566 None] group_snapshot 1736f083-903e-4129-a19b-56119f9b94fa: deleting {{(pid=82819) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 02 12:35:06 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-99bf3dcb-981e-4900-8a82-fb785af0e7d3 tempest-GroupSnapshotsV319Test-1741884566 None] Acquiring lock "cinder-quobyte-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:35:06 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-99bf3dcb-981e-4900-8a82-fb785af0e7d3 tempest-GroupSnapshotsV319Test-1741884566 None] Lock "cinder-quobyte-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:35:06 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-99bf3dcb-981e-4900-8a82-fb785af0e7d3 tempest-GroupSnapshotsV319Test-1741884566 None] Acquiring lock "cinder-quobyte-12a31d7e-ba6d-4ef6-96f7-2b771d1b54ef" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:35:06 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-99bf3dcb-981e-4900-8a82-fb785af0e7d3 tempest-GroupSnapshotsV319Test-1741884566 None] Lock "cinder-quobyte-12a31d7e-ba6d-4ef6-96f7-2b771d1b54ef" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:35:06 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-99bf3dcb-981e-4900-8a82-fb785af0e7d3 tempest-GroupSnapshotsV319Test-1741884566 None] Deleting offline snapshot 12a31d7e-ba6d-4ef6-96f7-2b771d1b54ef of volume 6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:35:06 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-99bf3dcb-981e-4900-8a82-fb785af0e7d3 tempest-GroupSnapshotsV319Test-1741884566 None] snapshot_file for this snap is: volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3.12a31d7e-ba6d-4ef6-96f7-2b771d1b54ef {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:35:06 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2962d3-815b-462d-a9ab-9635c2a848a5]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:35:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-99bf3dcb-981e-4900-8a82-fb785af0e7d3 tempest-GroupSnapshotsV319Test-1741884566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3.12a31d7e-ba6d-4ef6-96f7-2b771d1b54ef {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:06 devstack sudo[83603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3.12a31d7e-ba6d-4ef6-96f7-2b771d1b54ef Apr 02 12:35:06 devstack sudo[83603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:06 devstack sudo[83600]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ef471137-e0c4-4a6e-b705-983da6664bff" returned: 0 in 0.670s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:06 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:35:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 5.196s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:06 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Cloning volume f51a100b-1b3a-4975-9cce-fd745bbd9aab to volume ae70b3df-6495-46d2-a5f1-d2742bc62d9e Apr 02 12:35:06 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7dda091-5bd7-4b90-bfdd-66099c785ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef471137-e0c4-4a6e-b705-983da6664bff', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:06 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a7a27d4-832a-43c2-b480-33ae2fe73726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:06 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Volume volume-ef471137-e0c4-4a6e-b705-983da6664bff (ef471137-e0c4-4a6e-b705-983da6664bff): created successfully Apr 02 12:35:06 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a7a27d4-832a-43c2-b480-33ae2fe73726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:06 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Flow 'volume_create_manager' (2207f8f5-59bb-4967-91f5-f748c15f6cee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:35:06 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Creating offline snapshot e4e9930e-f317-427c-b62f-75392ada811d of volume f51a100b-1b3a-4975-9cce-fd745bbd9aab {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:35:06 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-91b5de03-5cf9-41d9-a5e3-fd0079e6edb0 tempest-VolumesAdminNegativeTest-366900166 None] Created volume successfully. Apr 02 12:35:06 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1ceb2e-9eca-4ce3-8025-abf201e64367]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:35:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:06 devstack sudo[83607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab Apr 02 12:35:06 devstack sudo[83607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:06 devstack sudo[83603]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-99bf3dcb-981e-4900-8a82-fb785af0e7d3 tempest-GroupSnapshotsV319Test-1741884566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3.12a31d7e-ba6d-4ef6-96f7-2b771d1b54ef" returned: 0 in 0.660s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:06 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-99bf3dcb-981e-4900-8a82-fb785af0e7d3 tempest-GroupSnapshotsV319Test-1741884566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:35:06 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0a4773-cefe-49b1-bd2d-16001bfaa9e7]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:35:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-99bf3dcb-981e-4900-8a82-fb785af0e7d3 tempest-GroupSnapshotsV319Test-1741884566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:06 devstack sudo[83612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3 Apr 02 12:35:06 devstack sudo[83612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:07 devstack sudo[83607]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab" returned: 0 in 0.573s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.e4e9930e-f317-427c-b62f-75392ada811d 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:07 devstack sudo[83618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.e4e9930e-f317-427c-b62f-75392ada811d 1G Apr 02 12:35:07 devstack sudo[83618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:07 devstack sudo[83612]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-99bf3dcb-981e-4900-8a82-fb785af0e7d3 tempest-GroupSnapshotsV319Test-1741884566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3" returned: 0 in 0.582s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-99bf3dcb-981e-4900-8a82-fb785af0e7d3 tempest-GroupSnapshotsV319Test-1741884566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3.12a31d7e-ba6d-4ef6-96f7-2b771d1b54ef {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:07 devstack sudo[83624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3.12a31d7e-ba6d-4ef6-96f7-2b771d1b54ef Apr 02 12:35:07 devstack sudo[83624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:07 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2517e0a1-feec-48e6-974b-08d5076603ad tempest-VolumesAdminNegativeTest-366900166 None] Acquiring lock "cinder-ef471137-e0c4-4a6e-b705-983da6664bff-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:35:07 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2517e0a1-feec-48e6-974b-08d5076603ad tempest-VolumesAdminNegativeTest-366900166 None] Lock "cinder-ef471137-e0c4-4a6e-b705-983da6664bff-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:35:07 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2517e0a1-feec-48e6-974b-08d5076603ad tempest-VolumesAdminNegativeTest-366900166 None] Acquiring lock "cinder-quobyte-ef471137-e0c4-4a6e-b705-983da6664bff" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:35:07 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2517e0a1-feec-48e6-974b-08d5076603ad tempest-VolumesAdminNegativeTest-366900166 None] Lock "cinder-quobyte-ef471137-e0c4-4a6e-b705-983da6664bff" acquired by "delete_volume" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:35:07 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fe8366-40dd-4882-98e8-502d62b746c6]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:35:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2517e0a1-feec-48e6-974b-08d5076603ad tempest-VolumesAdminNegativeTest-366900166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ef471137-e0c4-4a6e-b705-983da6664bff {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:07 devstack sudo[83618]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.e4e9930e-f317-427c-b62f-75392ada811d 1G" returned: 0 in 0.636s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.e4e9930e-f317-427c-b62f-75392ada811d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:07 devstack sudo[83631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.e4e9930e-f317-427c-b62f-75392ada811d Apr 02 12:35:07 devstack sudo[83631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:07 devstack sudo[83630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ef471137-e0c4-4a6e-b705-983da6664bff Apr 02 12:35:07 devstack sudo[83630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:07 devstack sudo[83624]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-99bf3dcb-981e-4900-8a82-fb785af0e7d3 tempest-GroupSnapshotsV319Test-1741884566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3.12a31d7e-ba6d-4ef6-96f7-2b771d1b54ef" returned: 0 in 0.601s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-99bf3dcb-981e-4900-8a82-fb785af0e7d3 tempest-GroupSnapshotsV319Test-1741884566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3.12a31d7e-ba6d-4ef6-96f7-2b771d1b54ef {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:07 devstack sudo[83637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3.12a31d7e-ba6d-4ef6-96f7-2b771d1b54ef Apr 02 12:35:07 devstack sudo[83637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:08 devstack sudo[83631]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.e4e9930e-f317-427c-b62f-75392ada811d" returned: 0 in 0.575s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:08 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.e4e9930e-f317-427c-b62f-75392ada811d is being set with open permissions: ugo+rw: NotImplementedError Apr 02 12:35:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.e4e9930e-f317-427c-b62f-75392ada811d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:08 devstack sudo[83646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.e4e9930e-f317-427c-b62f-75392ada811d Apr 02 12:35:08 devstack sudo[83646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:08 devstack sudo[83630]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2517e0a1-feec-48e6-974b-08d5076603ad tempest-VolumesAdminNegativeTest-366900166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ef471137-e0c4-4a6e-b705-983da6664bff" returned: 0 in 0.710s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2517e0a1-feec-48e6-974b-08d5076603ad tempest-VolumesAdminNegativeTest-366900166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ef471137-e0c4-4a6e-b705-983da6664bff {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:08 devstack sudo[83650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ef471137-e0c4-4a6e-b705-983da6664bff Apr 02 12:35:08 devstack sudo[83650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:08 devstack sudo[83637]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-99bf3dcb-981e-4900-8a82-fb785af0e7d3 tempest-GroupSnapshotsV319Test-1741884566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3.12a31d7e-ba6d-4ef6-96f7-2b771d1b54ef" returned: 0 in 0.628s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:08 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-99bf3dcb-981e-4900-8a82-fb785af0e7d3 tempest-GroupSnapshotsV319Test-1741884566 None] Lock "cinder-quobyte-12a31d7e-ba6d-4ef6-96f7-2b771d1b54ef" released by "_delete_snapshot" :: held 2.534s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:35:08 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-99bf3dcb-981e-4900-8a82-fb785af0e7d3 tempest-GroupSnapshotsV319Test-1741884566 None] Lock "cinder-quobyte-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3" released by "delete_snapshot" :: held 2.566s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:35:08 devstack cinder-volume[82819]: WARNING cinder.quota [None req-99bf3dcb-981e-4900-8a82-fb785af0e7d3 tempest-GroupSnapshotsV319Test-1741884566 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-467024868 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-467024868, it is now deprecated. Please use the default quota class for default quota. Apr 02 12:35:08 devstack cinder-volume[82819]: WARNING cinder.quota [None req-99bf3dcb-981e-4900-8a82-fb785af0e7d3 tempest-GroupSnapshotsV319Test-1741884566 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-467024868 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-467024868, it is now deprecated. Please use the default quota class for default quota. Apr 02 12:35:08 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-99bf3dcb-981e-4900-8a82-fb785af0e7d3 tempest-GroupSnapshotsV319Test-1741884566 None] Created reservations ['37c11caf-ae12-49d4-8ebe-1d279e40f9c0', 'f756183d-bab2-4922-9247-dc47a19266e1', 'ca719419-bcfe-475b-894d-2b5b2195149b', 'a10ba221-52b8-4a18-a560-1919fb38f5bc'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:35:08 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-99bf3dcb-981e-4900-8a82-fb785af0e7d3 tempest-GroupSnapshotsV319Test-1741884566 None] group_snapshot 1736f083-903e-4129-a19b-56119f9b94fa: deleted successfully Apr 02 12:35:08 devstack sudo[83646]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.e4e9930e-f317-427c-b62f-75392ada811d" returned: 0 in 0.584s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:08 devstack sudo[83656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.info Apr 02 12:35:08 devstack sudo[83656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:08 devstack sudo[83650]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2517e0a1-feec-48e6-974b-08d5076603ad tempest-VolumesAdminNegativeTest-366900166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ef471137-e0c4-4a6e-b705-983da6664bff" returned: 0 in 0.572s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:08 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2517e0a1-feec-48e6-974b-08d5076603ad tempest-VolumesAdminNegativeTest-366900166 None] Lock "cinder-quobyte-ef471137-e0c4-4a6e-b705-983da6664bff" released by "delete_volume" :: held 1.309s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:35:09 devstack cinder-volume[82819]: WARNING cinder.quota [None req-2517e0a1-feec-48e6-974b-08d5076603ad tempest-VolumesAdminNegativeTest-366900166 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 02 12:35:09 devstack cinder-volume[82819]: WARNING cinder.quota [None req-2517e0a1-feec-48e6-974b-08d5076603ad tempest-VolumesAdminNegativeTest-366900166 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 02 12:35:09 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-2517e0a1-feec-48e6-974b-08d5076603ad tempest-VolumesAdminNegativeTest-366900166 None] Created reservations ['f2cb2a95-294e-4bad-8f07-9c927348f80f', '080611f2-f396-4e20-9d96-0e8586df3de7', '1e28fdab-6a28-4b58-adba-0c2d63eceaee', '2c8a9fd5-b702-4504-9a80-2cdc1668712d'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:35:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2517e0a1-feec-48e6-974b-08d5076603ad tempest-VolumesAdminNegativeTest-366900166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2517e0a1-feec-48e6-974b-08d5076603ad tempest-VolumesAdminNegativeTest-366900166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:09 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2517e0a1-feec-48e6-974b-08d5076603ad tempest-VolumesAdminNegativeTest-366900166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:35:09 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2517e0a1-feec-48e6-974b-08d5076603ad tempest-VolumesAdminNegativeTest-366900166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:35:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2517e0a1-feec-48e6-974b-08d5076603ad tempest-VolumesAdminNegativeTest-366900166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2517e0a1-feec-48e6-974b-08d5076603ad tempest-VolumesAdminNegativeTest-366900166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:09 devstack sudo[83658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:35:09 devstack sudo[83658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:09 devstack sudo[83656]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.info" returned: 0 in 0.538s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:09 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.info is being set with open permissions: ugo+rw: NotImplementedError Apr 02 12:35:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:09 devstack sudo[83663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.info Apr 02 12:35:09 devstack sudo[83663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:09 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-02c12521-ad44-4dde-8a9e-f9cc24cafe63 tempest-GroupSnapshotsV319Test-1741884566 None] Acquiring lock "cinder-quobyte-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:35:09 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-02c12521-ad44-4dde-8a9e-f9cc24cafe63 tempest-GroupSnapshotsV319Test-1741884566 None] Lock "cinder-quobyte-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3" acquired by "delete_volume" :: waited 0.013s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:35:09 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[13626c9c-e1f6-44a3-b7ad-23c191cc52ab]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:35:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-02c12521-ad44-4dde-8a9e-f9cc24cafe63 tempest-GroupSnapshotsV319Test-1741884566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:09 devstack sudo[83658]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2517e0a1-feec-48e6-974b-08d5076603ad tempest-VolumesAdminNegativeTest-366900166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.778s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:09 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-2517e0a1-feec-48e6-974b-08d5076603ad tempest-VolumesAdminNegativeTest-366900166 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:35:09 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-2517e0a1-feec-48e6-974b-08d5076603ad tempest-VolumesAdminNegativeTest-366900166 None] Deleted volume successfully. Apr 02 12:35:09 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2517e0a1-feec-48e6-974b-08d5076603ad tempest-VolumesAdminNegativeTest-366900166 None] Lock "cinder-ef471137-e0c4-4a6e-b705-983da6664bff-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:35:09 devstack sudo[83667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3 Apr 02 12:35:09 devstack sudo[83667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:10 devstack sudo[83663]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.info" returned: 0 in 0.877s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:10 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Acquiring lock "cinder-quobyte-ae70b3df-6495-46d2-a5f1-d2742bc62d9e" by "_copy_volume_from_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:35:10 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Lock "cinder-quobyte-ae70b3df-6495-46d2-a5f1-d2742bc62d9e" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:35:10 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] snapshot: e4e9930e-f317-427c-b62f-75392ada811d, volume: ae70b3df-6495-46d2-a5f1-d2742bc62d9e, {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 12:35:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:10 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:35:10 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:35:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:10 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c723be2-a7c4-44f3-a9c9-15731bf6839d]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:35:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.e4e9930e-f317-427c-b62f-75392ada811d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:10 devstack sudo[83674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.e4e9930e-f317-427c-b62f-75392ada811d Apr 02 12:35:10 devstack sudo[83674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:11 devstack sudo[83667]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-02c12521-ad44-4dde-8a9e-f9cc24cafe63 tempest-GroupSnapshotsV319Test-1741884566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3" returned: 0 in 1.200s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-02c12521-ad44-4dde-8a9e-f9cc24cafe63 tempest-GroupSnapshotsV319Test-1741884566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:11 devstack sudo[83683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3 Apr 02 12:35:11 devstack sudo[83683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:11 devstack sudo[83674]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.e4e9930e-f317-427c-b62f-75392ada811d" returned: 0 in 0.749s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:11 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:35:11 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 12:35:11 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Creating direct copy from snapshot {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 12:35:11 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f55855-65dd-4509-af3f-9b807c7f0596]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:35:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:11 devstack sudo[83686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab Apr 02 12:35:11 devstack sudo[83686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:11 devstack sudo[83683]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-02c12521-ad44-4dde-8a9e-f9cc24cafe63 tempest-GroupSnapshotsV319Test-1741884566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3" returned: 0 in 0.705s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:11 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-02c12521-ad44-4dde-8a9e-f9cc24cafe63 tempest-GroupSnapshotsV319Test-1741884566 None] Lock "cinder-quobyte-6d4fdb30-4c3e-4ff3-a041-f7baa7d3b7f3" released by "delete_volume" :: held 1.957s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:35:11 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-02c12521-ad44-4dde-8a9e-f9cc24cafe63 tempest-GroupSnapshotsV319Test-1741884566 None] Created reservations ['f360d411-4a93-4ed9-8b6a-31c43adb28bd'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:35:11 devstack cinder-volume[82819]: WARNING cinder.quota [None req-02c12521-ad44-4dde-8a9e-f9cc24cafe63 tempest-GroupSnapshotsV319Test-1741884566 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-467024868 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-467024868, it is now deprecated. Please use the default quota class for default quota. Apr 02 12:35:11 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-02c12521-ad44-4dde-8a9e-f9cc24cafe63 tempest-GroupSnapshotsV319Test-1741884566 None] Created reservations ['21f3c768-0f6b-4f49-a6f5-ad57a6cee486', 'f0a113c8-16fa-40a7-b478-370b5f8b5d4a', '83d3770d-adb9-4a83-8280-ac648906f8d4', '075ff675-5d6f-4a52-b27e-b9f245cee6be'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:35:12 devstack sudo[83686]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab" returned: 0 in 0.860s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:12 devstack cinder-volume[82819]: DEBUG cinder.utils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Path /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ae70b3df-6495-46d2-a5f1-d2742bc62d9e not found in is_blk_device check {{(pid=82819) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 12:35:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ae70b3df-6495-46d2-a5f1-d2742bc62d9e {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:12 devstack sudo[83737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ae70b3df-6495-46d2-a5f1-d2742bc62d9e Apr 02 12:35:12 devstack sudo[83737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-02c12521-ad44-4dde-8a9e-f9cc24cafe63 tempest-GroupSnapshotsV319Test-1741884566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-02c12521-ad44-4dde-8a9e-f9cc24cafe63 tempest-GroupSnapshotsV319Test-1741884566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:12 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-02c12521-ad44-4dde-8a9e-f9cc24cafe63 tempest-GroupSnapshotsV319Test-1741884566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:35:12 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-02c12521-ad44-4dde-8a9e-f9cc24cafe63 tempest-GroupSnapshotsV319Test-1741884566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:35:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-02c12521-ad44-4dde-8a9e-f9cc24cafe63 tempest-GroupSnapshotsV319Test-1741884566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-02c12521-ad44-4dde-8a9e-f9cc24cafe63 tempest-GroupSnapshotsV319Test-1741884566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:12 devstack sudo[83740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:35:12 devstack sudo[83740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:12 devstack sudo[83740]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-02c12521-ad44-4dde-8a9e-f9cc24cafe63 tempest-GroupSnapshotsV319Test-1741884566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.598s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:12 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-02c12521-ad44-4dde-8a9e-f9cc24cafe63 tempest-GroupSnapshotsV319Test-1741884566 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:35:12 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-02c12521-ad44-4dde-8a9e-f9cc24cafe63 tempest-GroupSnapshotsV319Test-1741884566 None] Delete group completed successfully. Apr 02 12:35:13 devstack cinder-volume[82819]: DEBUG oslo_service.periodic_task [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82819) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 12:35:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:35:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:35:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:13 devstack sudo[83772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:35:13 devstack sudo[83772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:15 devstack sudo[83772]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 1.997s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:15 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:35:15 devstack sudo[83737]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ae70b3df-6495-46d2-a5f1-d2742bc62d9e" returned: 0 in 3.152s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:15 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec10d26-1153-4d76-a410-a4f90409ab16]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:35:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:15 devstack sudo[83782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab Apr 02 12:35:15 devstack sudo[83782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:15 devstack sudo[83782]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab" returned: 0 in 0.799s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:15 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab, size 1024.00 MB, duration 3.15 sec, destination /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ae70b3df-6495-46d2-a5f1-d2742bc62d9e {{(pid=82819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 12:35:15 devstack cinder-volume[82819]: INFO cinder.image.image_utils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Converted 1024.00 MB image at 324.73 MB/s Apr 02 12:35:15 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ae70b3df-6495-46d2-a5f1-d2742bc62d9e is being set with open permissions: ugo+rw: NotImplementedError Apr 02 12:35:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ae70b3df-6495-46d2-a5f1-d2742bc62d9e {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:16 devstack sudo[83794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ae70b3df-6495-46d2-a5f1-d2742bc62d9e Apr 02 12:35:16 devstack sudo[83794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:16 devstack sudo[83794]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ae70b3df-6495-46d2-a5f1-d2742bc62d9e" returned: 0 in 0.494s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Lock "cinder-quobyte-ae70b3df-6495-46d2-a5f1-d2742bc62d9e" released by "_copy_volume_from_snapshot" :: held 6.130s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:35:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Acquiring lock "cinder-quobyte-e4e9930e-f317-427c-b62f-75392ada811d" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:35:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Lock "cinder-quobyte-e4e9930e-f317-427c-b62f-75392ada811d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:35:16 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Deleting offline snapshot e4e9930e-f317-427c-b62f-75392ada811d of volume f51a100b-1b3a-4975-9cce-fd745bbd9aab {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:35:16 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] snapshot_file for this snap is: volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.e4e9930e-f317-427c-b62f-75392ada811d {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:35:16 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b10a08c-1e3b-4bba-84ef-5b4be75e8177]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:35:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.e4e9930e-f317-427c-b62f-75392ada811d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:16 devstack sudo[83800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.e4e9930e-f317-427c-b62f-75392ada811d Apr 02 12:35:16 devstack sudo[83800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:17 devstack sudo[83800]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.e4e9930e-f317-427c-b62f-75392ada811d" returned: 0 in 0.631s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:17 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:35:17 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1ffda0-e9ea-46c4-af29-5e3b09c0ac88]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:35:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:17 devstack sudo[83810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab Apr 02 12:35:17 devstack sudo[83810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:17 devstack sudo[83810]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab" returned: 0 in 0.505s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.e4e9930e-f317-427c-b62f-75392ada811d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:17 devstack sudo[83819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.e4e9930e-f317-427c-b62f-75392ada811d Apr 02 12:35:17 devstack sudo[83819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:18 devstack sudo[83819]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.e4e9930e-f317-427c-b62f-75392ada811d" returned: 0 in 0.506s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.e4e9930e-f317-427c-b62f-75392ada811d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:18 devstack sudo[83825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.e4e9930e-f317-427c-b62f-75392ada811d Apr 02 12:35:18 devstack sudo[83825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:19 devstack sudo[83825]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:19 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-60e0b502-71fb-4896-8ce9-bbcb1e14fe4b tempest-GroupsTest-74115844 None] Group tempest-Group1-90228740: creating Apr 02 12:35:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab.e4e9930e-f317-427c-b62f-75392ada811d" returned: 0 in 0.888s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:19 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Lock "cinder-quobyte-e4e9930e-f317-427c-b62f-75392ada811d" released by "_delete_snapshot" :: held 2.623s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:35:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.771s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:19 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-60e0b502-71fb-4896-8ce9-bbcb1e14fe4b tempest-GroupsTest-74115844 None] Group tempest-Group1-90228740: created successfully Apr 02 12:35:19 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-60e0b502-71fb-4896-8ce9-bbcb1e14fe4b tempest-GroupsTest-74115844 None] Create group completed successfully. Apr 02 12:35:19 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-a4f8ece8-0bd2-4242-aa0b-0354e423e6fd tempest-GroupsV314Test-2110680073 None] Create group from source-group-c21f3b00-c000-4df5-9e4e-b6b78f1d44ce completed successfully. Apr 02 12:35:20 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1fcd207b-3b71-4b06-8ea7-3632d051c761 tempest-GroupsV314Test-2110680073 None] Acquiring lock "cinder-quobyte-ae70b3df-6495-46d2-a5f1-d2742bc62d9e" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:35:20 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1fcd207b-3b71-4b06-8ea7-3632d051c761 tempest-GroupsV314Test-2110680073 None] Lock "cinder-quobyte-ae70b3df-6495-46d2-a5f1-d2742bc62d9e" acquired by "delete_volume" :: waited 0.020s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:35:20 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc85e619-9dc4-46ae-867a-b31e85425f38]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:35:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1fcd207b-3b71-4b06-8ea7-3632d051c761 tempest-GroupsV314Test-2110680073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ae70b3df-6495-46d2-a5f1-d2742bc62d9e {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:20 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-8ea5e061-5ee6-424b-b4bc-b83c110412a4 tempest-GroupsTest-74115844 None] Group tempest-Group2-148373041: creating Apr 02 12:35:20 devstack sudo[83857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ae70b3df-6495-46d2-a5f1-d2742bc62d9e Apr 02 12:35:20 devstack sudo[83857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:20 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-8ea5e061-5ee6-424b-b4bc-b83c110412a4 tempest-GroupsTest-74115844 None] Group tempest-Group2-148373041: created successfully Apr 02 12:35:20 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-8ea5e061-5ee6-424b-b4bc-b83c110412a4 tempest-GroupsTest-74115844 None] Create group completed successfully. Apr 02 12:35:20 devstack sudo[83857]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1fcd207b-3b71-4b06-8ea7-3632d051c761 tempest-GroupsV314Test-2110680073 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ae70b3df-6495-46d2-a5f1-d2742bc62d9e" returned: 0 in 0.632s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1fcd207b-3b71-4b06-8ea7-3632d051c761 tempest-GroupsV314Test-2110680073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ae70b3df-6495-46d2-a5f1-d2742bc62d9e {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:20 devstack sudo[83862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ae70b3df-6495-46d2-a5f1-d2742bc62d9e Apr 02 12:35:20 devstack sudo[83862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:21 devstack sudo[83862]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1fcd207b-3b71-4b06-8ea7-3632d051c761 tempest-GroupsV314Test-2110680073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ae70b3df-6495-46d2-a5f1-d2742bc62d9e" returned: 0 in 0.817s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:21 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1fcd207b-3b71-4b06-8ea7-3632d051c761 tempest-GroupsV314Test-2110680073 None] Lock "cinder-quobyte-ae70b3df-6495-46d2-a5f1-d2742bc62d9e" released by "delete_volume" :: held 1.501s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:35:21 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-1fcd207b-3b71-4b06-8ea7-3632d051c761 tempest-GroupsV314Test-2110680073 None] Created reservations ['d22b04c3-c7b0-42dc-a605-3052c3b0b090'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:35:21 devstack cinder-volume[82819]: WARNING cinder.quota [None req-1fcd207b-3b71-4b06-8ea7-3632d051c761 tempest-GroupsV314Test-2110680073 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1700685208 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1700685208, it is now deprecated. Please use the default quota class for default quota. Apr 02 12:35:21 devstack cinder-volume[82819]: WARNING cinder.quota [None req-1fcd207b-3b71-4b06-8ea7-3632d051c761 tempest-GroupsV314Test-2110680073 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1700685208 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1700685208, it is now deprecated. Please use the default quota class for default quota. Apr 02 12:35:21 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-1fcd207b-3b71-4b06-8ea7-3632d051c761 tempest-GroupsV314Test-2110680073 None] Created reservations ['53f51277-4f24-4aa7-82be-e4862a567580', '16075733-382c-4e1d-95f2-f5fefc152126', 'e8f1db62-8300-4ac9-a707-5aa566945371', '1183abc2-04dd-4029-968a-f4de67f22a4b'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-1fcd207b-3b71-4b06-8ea7-3632d051c761 tempest-GroupsV314Test-2110680073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-1fcd207b-3b71-4b06-8ea7-3632d051c761 tempest-GroupsV314Test-2110680073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-1fcd207b-3b71-4b06-8ea7-3632d051c761 tempest-GroupsV314Test-2110680073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-1fcd207b-3b71-4b06-8ea7-3632d051c761 tempest-GroupsV314Test-2110680073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-1fcd207b-3b71-4b06-8ea7-3632d051c761 tempest-GroupsV314Test-2110680073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1fcd207b-3b71-4b06-8ea7-3632d051c761 tempest-GroupsV314Test-2110680073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:22 devstack sudo[83867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:35:22 devstack sudo[83867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Flow 'volume_create_manager' (489972b6-f184-400c-a6be-8bde7bb12c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26417ad2-d7cb-41a6-a522-91ed504b2e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26417ad2-d7cb-41a6-a522-91ed504b2e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1681721459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=97862c22-e758-4e14-acf8-04df5cc0e7ab,host='devstack@QuobyteHD#QuobyteHD',id=9e561610-2d4b-4be5-8032-efdacf3bf1ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='380578f7c37d40b9adf8877619a15256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:35:22Z,use_quota=True,user_id='a2bcf64c063e4b8285b890c7cd7833ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e9ac968-9580-4512-aa20-3e9265865f06),volume_type_id=1e9ac968-9580-4512-aa20-3e9265865f06)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07309a3c-f068-4f02-9840-559b7943fa4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07309a3c-f068-4f02-9840-559b7943fa4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7e45e1b-0346-42ca-998c-45ca12e15d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7e45e1b-0346-42ca-998c-45ca12e15d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e561610-2d4b-4be5-8032-efdacf3bf1ab', 'volume_name': 'volume-9e561610-2d4b-4be5-8032-efdacf3bf1ab', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a7a3a7-ea8f-476f-aaaa-e43a22ddde36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a7a3a7-ea8f-476f-aaaa-e43a22ddde36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d20d11d-0e4a-4f49-918d-9a0b6d09a4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:22 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Volume 9e561610-2d4b-4be5-8032-efdacf3bf1ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e561610-2d4b-4be5-8032-efdacf3bf1ab', 'volume_size': 1} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=97862c22-e758-4e14-acf8-04df5cc0e7ab,created_at=2026-04-02T10:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1681721459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=97862c22-e758-4e14-acf8-04df5cc0e7ab,host='devstack@QuobyteHD#QuobyteHD',id=9e561610-2d4b-4be5-8032-efdacf3bf1ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='380578f7c37d40b9adf8877619a15256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:35:22Z,use_quota=True,user_id='a2bcf64c063e4b8285b890c7cd7833ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e9ac968-9580-4512-aa20-3e9265865f06),volume_type_id=1e9ac968-9580-4512-aa20-3e9265865f06)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Creating volume 9e561610-2d4b-4be5-8032-efdacf3bf1ab {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:35:22 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9e561610-2d4b-4be5-8032-efdacf3bf1ab 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:22 devstack sudo[83869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9e561610-2d4b-4be5-8032-efdacf3bf1ab 1073741824 Apr 02 12:35:22 devstack sudo[83869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-5e1b8f03-91ed-4653-8da7-d101e1516a61 tempest-GroupsV314Test-2110680073 None] Acquiring lock "cinder-quobyte-f51a100b-1b3a-4975-9cce-fd745bbd9aab" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-5e1b8f03-91ed-4653-8da7-d101e1516a61 tempest-GroupsV314Test-2110680073 None] Lock "cinder-quobyte-f51a100b-1b3a-4975-9cce-fd745bbd9aab" acquired by "delete_volume" :: waited 0.013s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bb94bb-a251-4a24-a233-4cf025b9dc99]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:35:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5e1b8f03-91ed-4653-8da7-d101e1516a61 tempest-GroupsV314Test-2110680073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:22 devstack sudo[83873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab Apr 02 12:35:22 devstack sudo[83873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:23 devstack sudo[83867]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1fcd207b-3b71-4b06-8ea7-3632d051c761 tempest-GroupsV314Test-2110680073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 1.026s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:23 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-1fcd207b-3b71-4b06-8ea7-3632d051c761 tempest-GroupsV314Test-2110680073 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:35:23 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-1fcd207b-3b71-4b06-8ea7-3632d051c761 tempest-GroupsV314Test-2110680073 None] Delete group completed successfully. Apr 02 12:35:23 devstack sudo[83869]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9e561610-2d4b-4be5-8032-efdacf3bf1ab 1073741824" returned: 0 in 0.820s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9e561610-2d4b-4be5-8032-efdacf3bf1ab {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:23 devstack sudo[83879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9e561610-2d4b-4be5-8032-efdacf3bf1ab Apr 02 12:35:23 devstack sudo[83879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:23 devstack sudo[83873]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5e1b8f03-91ed-4653-8da7-d101e1516a61 tempest-GroupsV314Test-2110680073 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab" returned: 0 in 0.728s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5e1b8f03-91ed-4653-8da7-d101e1516a61 tempest-GroupsV314Test-2110680073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:23 devstack sudo[83884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab Apr 02 12:35:23 devstack sudo[83884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:23 devstack sudo[83879]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9e561610-2d4b-4be5-8032-efdacf3bf1ab" returned: 0 in 0.558s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:23 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:35:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:23 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d20d11d-0e4a-4f49-918d-9a0b6d09a4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e561610-2d4b-4be5-8032-efdacf3bf1ab', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:23 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eaa3696-fee4-4f0f-af67-a3593bc55975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:23 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Volume volume-9e561610-2d4b-4be5-8032-efdacf3bf1ab (9e561610-2d4b-4be5-8032-efdacf3bf1ab): created successfully Apr 02 12:35:23 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eaa3696-fee4-4f0f-af67-a3593bc55975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:23 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Flow 'volume_create_manager' (489972b6-f184-400c-a6be-8bde7bb12c42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:35:23 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-9c949d34-1aec-435a-8540-2879541ffac9 tempest-GroupsTest-74115844 None] Created volume successfully. Apr 02 12:35:24 devstack sudo[83884]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5e1b8f03-91ed-4653-8da7-d101e1516a61 tempest-GroupsV314Test-2110680073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f51a100b-1b3a-4975-9cce-fd745bbd9aab" returned: 0 in 0.590s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:24 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-5e1b8f03-91ed-4653-8da7-d101e1516a61 tempest-GroupsV314Test-2110680073 None] Lock "cinder-quobyte-f51a100b-1b3a-4975-9cce-fd745bbd9aab" released by "delete_volume" :: held 1.388s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:35:24 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-5e1b8f03-91ed-4653-8da7-d101e1516a61 tempest-GroupsV314Test-2110680073 None] Created reservations ['573ede0e-6174-43bc-bc7c-2bb25f50d5f1'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:35:24 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-5e1b8f03-91ed-4653-8da7-d101e1516a61 tempest-GroupsV314Test-2110680073 None] Created reservations ['cb0508fd-27d1-4735-a8e5-d92567553e98', 'a42bc966-b916-4398-8c6a-1ce8c881caf4', '57c1bb9e-4d30-4326-9941-91495c694bc3', '68ee6054-2371-4363-8e11-d5082a0e770d'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:35:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-5e1b8f03-91ed-4653-8da7-d101e1516a61 tempest-GroupsV314Test-2110680073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-5e1b8f03-91ed-4653-8da7-d101e1516a61 tempest-GroupsV314Test-2110680073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:24 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-5e1b8f03-91ed-4653-8da7-d101e1516a61 tempest-GroupsV314Test-2110680073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:35:24 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-5e1b8f03-91ed-4653-8da7-d101e1516a61 tempest-GroupsV314Test-2110680073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:35:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-5e1b8f03-91ed-4653-8da7-d101e1516a61 tempest-GroupsV314Test-2110680073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5e1b8f03-91ed-4653-8da7-d101e1516a61 tempest-GroupsV314Test-2110680073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:24 devstack sudo[83890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:35:24 devstack sudo[83890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:24 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b6b81d6c-7cad-4e05-bf85-2131b4ea3cee tempest-GroupsTest-74115844 None] Acquiring lock "cinder-quobyte-9e561610-2d4b-4be5-8032-efdacf3bf1ab" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:35:24 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b6b81d6c-7cad-4e05-bf85-2131b4ea3cee tempest-GroupsTest-74115844 None] Lock "cinder-quobyte-9e561610-2d4b-4be5-8032-efdacf3bf1ab" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:35:24 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a745200-0d36-4e3f-b30b-1d897148c7be]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:35:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b6b81d6c-7cad-4e05-bf85-2131b4ea3cee tempest-GroupsTest-74115844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9e561610-2d4b-4be5-8032-efdacf3bf1ab {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:25 devstack sudo[83890]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5e1b8f03-91ed-4653-8da7-d101e1516a61 tempest-GroupsV314Test-2110680073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.761s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:25 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-5e1b8f03-91ed-4653-8da7-d101e1516a61 tempest-GroupsV314Test-2110680073 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:35:25 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-5e1b8f03-91ed-4653-8da7-d101e1516a61 tempest-GroupsV314Test-2110680073 None] Delete group completed successfully. Apr 02 12:35:25 devstack sudo[83893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9e561610-2d4b-4be5-8032-efdacf3bf1ab Apr 02 12:35:25 devstack sudo[83893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:25 devstack sudo[83893]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b6b81d6c-7cad-4e05-bf85-2131b4ea3cee tempest-GroupsTest-74115844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9e561610-2d4b-4be5-8032-efdacf3bf1ab" returned: 0 in 0.923s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b6b81d6c-7cad-4e05-bf85-2131b4ea3cee tempest-GroupsTest-74115844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9e561610-2d4b-4be5-8032-efdacf3bf1ab {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:25 devstack sudo[83899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9e561610-2d4b-4be5-8032-efdacf3bf1ab Apr 02 12:35:25 devstack sudo[83899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:26 devstack sudo[83899]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b6b81d6c-7cad-4e05-bf85-2131b4ea3cee tempest-GroupsTest-74115844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9e561610-2d4b-4be5-8032-efdacf3bf1ab" returned: 0 in 1.017s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:26 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b6b81d6c-7cad-4e05-bf85-2131b4ea3cee tempest-GroupsTest-74115844 None] Lock "cinder-quobyte-9e561610-2d4b-4be5-8032-efdacf3bf1ab" released by "delete_volume" :: held 1.967s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:35:26 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-b6b81d6c-7cad-4e05-bf85-2131b4ea3cee tempest-GroupsTest-74115844 None] Created reservations ['1f450487-2b80-49ed-853b-f4b39bb9d89c'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:35:26 devstack cinder-volume[82819]: WARNING cinder.quota [None req-b6b81d6c-7cad-4e05-bf85-2131b4ea3cee tempest-GroupsTest-74115844 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1202871377 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1202871377, it is now deprecated. Please use the default quota class for default quota. Apr 02 12:35:26 devstack cinder-volume[82819]: WARNING cinder.quota [None req-b6b81d6c-7cad-4e05-bf85-2131b4ea3cee tempest-GroupsTest-74115844 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1202871377 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1202871377, it is now deprecated. Please use the default quota class for default quota. Apr 02 12:35:26 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-b6b81d6c-7cad-4e05-bf85-2131b4ea3cee tempest-GroupsTest-74115844 None] Created reservations ['991091e3-072d-4a97-b176-10f87b768a49', 'eac811d4-2a35-45db-b47b-c443cd5567b0', 'fa21bdc1-b432-4ab9-b7b2-9a207c9e0d33', 'bb81f9dc-86a2-4ba2-b483-88af755b2d29'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:35:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b6b81d6c-7cad-4e05-bf85-2131b4ea3cee tempest-GroupsTest-74115844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b6b81d6c-7cad-4e05-bf85-2131b4ea3cee tempest-GroupsTest-74115844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:27 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b6b81d6c-7cad-4e05-bf85-2131b4ea3cee tempest-GroupsTest-74115844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:35:27 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b6b81d6c-7cad-4e05-bf85-2131b4ea3cee tempest-GroupsTest-74115844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:35:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b6b81d6c-7cad-4e05-bf85-2131b4ea3cee tempest-GroupsTest-74115844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b6b81d6c-7cad-4e05-bf85-2131b4ea3cee tempest-GroupsTest-74115844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:27 devstack sudo[83928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:35:27 devstack sudo[83928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:27 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-cf8268d8-11f9-4262-9aaf-e7e71b80e2d2 tempest-GroupsTest-74115844 None] Created reservations ['df914ad5-7875-4566-985c-7db82617dcb2'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:35:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cf8268d8-11f9-4262-9aaf-e7e71b80e2d2 tempest-GroupsTest-74115844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cf8268d8-11f9-4262-9aaf-e7e71b80e2d2 tempest-GroupsTest-74115844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:27 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cf8268d8-11f9-4262-9aaf-e7e71b80e2d2 tempest-GroupsTest-74115844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:35:27 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cf8268d8-11f9-4262-9aaf-e7e71b80e2d2 tempest-GroupsTest-74115844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:35:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cf8268d8-11f9-4262-9aaf-e7e71b80e2d2 tempest-GroupsTest-74115844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cf8268d8-11f9-4262-9aaf-e7e71b80e2d2 tempest-GroupsTest-74115844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:27 devstack sudo[83931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:35:27 devstack sudo[83931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:28 devstack sudo[83928]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b6b81d6c-7cad-4e05-bf85-2131b4ea3cee tempest-GroupsTest-74115844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 1.132s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:28 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-b6b81d6c-7cad-4e05-bf85-2131b4ea3cee tempest-GroupsTest-74115844 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:35:28 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-b6b81d6c-7cad-4e05-bf85-2131b4ea3cee tempest-GroupsTest-74115844 None] Delete group completed successfully. Apr 02 12:35:28 devstack sudo[83931]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cf8268d8-11f9-4262-9aaf-e7e71b80e2d2 tempest-GroupsTest-74115844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.993s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:28 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-cf8268d8-11f9-4262-9aaf-e7e71b80e2d2 tempest-GroupsTest-74115844 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:35:28 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-cf8268d8-11f9-4262-9aaf-e7e71b80e2d2 tempest-GroupsTest-74115844 None] Delete group completed successfully. Apr 02 12:35:29 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-9cd6201c-3850-4271-bf76-13dacfc798a2 tempest-GroupsTest-74115844 None] Group tempest-GroupsTest-Group-914720882: creating Apr 02 12:35:29 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-9cd6201c-3850-4271-bf76-13dacfc798a2 tempest-GroupsTest-74115844 None] Group tempest-GroupsTest-Group-914720882: created successfully Apr 02 12:35:29 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-9cd6201c-3850-4271-bf76-13dacfc798a2 tempest-GroupsTest-74115844 None] Create group completed successfully. Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Flow 'volume_create_manager' (7e4f2b97-3054-4337-8f6e-c95e61f04a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf5defc-6198-479a-a656-1c8193b57d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf5defc-6198-479a-a656-1c8193b57d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-11088683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d1c32ef-e37a-428e-9c0a-22f2a4f242b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6a380a3e79f4058884608e611fda0fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:35:30Z,use_quota=True,user_id='b963de08b4c74cf0bf28c81a59ec00a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc1b429a-97b2-42fe-8625-a84192fed7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc1b429a-97b2-42fe-8625-a84192fed7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388ec86e-4aa3-4a29-afb9-0c5431e8f6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388ec86e-4aa3-4a29-afb9-0c5431e8f6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d1c32ef-e37a-428e-9c0a-22f2a4f242b8', 'volume_name': 'volume-6d1c32ef-e37a-428e-9c0a-22f2a4f242b8', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2f692b-003c-47a7-99f9-5d8e341d2473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2f692b-003c-47a7-99f9-5d8e341d2473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47b99f7-0c07-4237-9bb1-a2e4e7885b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:30 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Volume 6d1c32ef-e37a-428e-9c0a-22f2a4f242b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d1c32ef-e37a-428e-9c0a-22f2a4f242b8', 'volume_size': 1} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-11088683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d1c32ef-e37a-428e-9c0a-22f2a4f242b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6a380a3e79f4058884608e611fda0fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:35:30Z,use_quota=True,user_id='b963de08b4c74cf0bf28c81a59ec00a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Creating volume 6d1c32ef-e37a-428e-9c0a-22f2a4f242b8 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:35:30 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d1c32ef-e37a-428e-9c0a-22f2a4f242b8 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:30 devstack sudo[83936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d1c32ef-e37a-428e-9c0a-22f2a4f242b8 1073741824 Apr 02 12:35:30 devstack sudo[83936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Flow 'volume_create_manager' (44d2f28d-be22-44e7-a05e-7bc2e2213592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (104b66ca-623f-4610-8e99-fd6fece62144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (104b66ca-623f-4610-8e99-fd6fece62144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1867278023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7a050e30-4d04-4e66-adc5-2d0e65a6623c,host='devstack@QuobyteHD#QuobyteHD',id=7f57a31f-0cb6-458a-9201-94fae23883e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='380578f7c37d40b9adf8877619a15256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:35:31Z,use_quota=True,user_id='a2bcf64c063e4b8285b890c7cd7833ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e267e6d-d118-4beb-ba52-2a2376f065ee),volume_type_id=4e267e6d-d118-4beb-ba52-2a2376f065ee)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1b2058-5145-4799-bda1-37847425f299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1b2058-5145-4799-bda1-37847425f299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c888c9a6-9eb1-4391-b5ef-08b040e298df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c888c9a6-9eb1-4391-b5ef-08b040e298df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f57a31f-0cb6-458a-9201-94fae23883e6', 'volume_name': 'volume-7f57a31f-0cb6-458a-9201-94fae23883e6', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a403c5-d274-45d6-97ff-f0ad5856c098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a403c5-d274-45d6-97ff-f0ad5856c098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f898a1-2909-4729-bc75-bf791335cb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:30 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Volume 7f57a31f-0cb6-458a-9201-94fae23883e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f57a31f-0cb6-458a-9201-94fae23883e6', 'volume_size': 1} Apr 02 12:35:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:31 devstack sudo[83936]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d1c32ef-e37a-428e-9c0a-22f2a4f242b8 1073741824" returned: 0 in 0.730s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d1c32ef-e37a-428e-9c0a-22f2a4f242b8 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:31 devstack sudo[83941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d1c32ef-e37a-428e-9c0a-22f2a4f242b8 Apr 02 12:35:31 devstack sudo[83941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:31 devstack sudo[83941]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d1c32ef-e37a-428e-9c0a-22f2a4f242b8" returned: 0 in 0.707s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:31 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:35:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.058s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:31 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7a050e30-4d04-4e66-adc5-2d0e65a6623c,created_at=2026-04-02T10:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1867278023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7a050e30-4d04-4e66-adc5-2d0e65a6623c,host='devstack@QuobyteHD#QuobyteHD',id=7f57a31f-0cb6-458a-9201-94fae23883e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='380578f7c37d40b9adf8877619a15256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:35:31Z,use_quota=True,user_id='a2bcf64c063e4b8285b890c7cd7833ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e267e6d-d118-4beb-ba52-2a2376f065ee),volume_type_id=4e267e6d-d118-4beb-ba52-2a2376f065ee)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:35:31 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Creating volume 7f57a31f-0cb6-458a-9201-94fae23883e6 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:35:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:31 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:35:31 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:35:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:31 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:35:31 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:35:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7f57a31f-0cb6-458a-9201-94fae23883e6 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:32 devstack sudo[83945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7f57a31f-0cb6-458a-9201-94fae23883e6 1073741824 Apr 02 12:35:32 devstack sudo[83945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47b99f7-0c07-4237-9bb1-a2e4e7885b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d1c32ef-e37a-428e-9c0a-22f2a4f242b8', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e38242-2f57-494f-b765-cad2958295b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:32 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Volume volume-6d1c32ef-e37a-428e-9c0a-22f2a4f242b8 (6d1c32ef-e37a-428e-9c0a-22f2a4f242b8): created successfully Apr 02 12:35:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e38242-2f57-494f-b765-cad2958295b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Flow 'volume_create_manager' (7e4f2b97-3054-4337-8f6e-c95e61f04a5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:35:32 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-ea92bec2-dc53-4924-bf11-dcc553d4e71f tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Created volume successfully. Apr 02 12:35:33 devstack sudo[83945]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7f57a31f-0cb6-458a-9201-94fae23883e6 1073741824" returned: 0 in 1.117s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7f57a31f-0cb6-458a-9201-94fae23883e6 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:33 devstack sudo[83957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7f57a31f-0cb6-458a-9201-94fae23883e6 Apr 02 12:35:33 devstack sudo[83957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:33 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-918cd672-2026-450e-80ea-14c629b02509 tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Acquiring lock "cinder-6d1c32ef-e37a-428e-9c0a-22f2a4f242b8-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:35:33 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-918cd672-2026-450e-80ea-14c629b02509 tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Lock "cinder-6d1c32ef-e37a-428e-9c0a-22f2a4f242b8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:35:33 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-918cd672-2026-450e-80ea-14c629b02509 tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Acquiring lock "cinder-quobyte-6d1c32ef-e37a-428e-9c0a-22f2a4f242b8" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:35:33 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-918cd672-2026-450e-80ea-14c629b02509 tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Lock "cinder-quobyte-6d1c32ef-e37a-428e-9c0a-22f2a4f242b8" acquired by "delete_volume" :: waited 0.022s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:35:33 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f51658-8a9e-4fdf-b257-559c564d0fa4]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:35:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-918cd672-2026-450e-80ea-14c629b02509 tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d1c32ef-e37a-428e-9c0a-22f2a4f242b8 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:33 devstack sudo[83957]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7f57a31f-0cb6-458a-9201-94fae23883e6" returned: 0 in 0.750s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:33 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] <== create_volume: return (1910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:35:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f898a1-2909-4729-bc75-bf791335cb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f57a31f-0cb6-458a-9201-94fae23883e6', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb792ba-96c5-4ee9-890a-df03f29b3201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:33 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Volume volume-7f57a31f-0cb6-458a-9201-94fae23883e6 (7f57a31f-0cb6-458a-9201-94fae23883e6): created successfully Apr 02 12:35:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb792ba-96c5-4ee9-890a-df03f29b3201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Flow 'volume_create_manager' (44d2f28d-be22-44e7-a05e-7bc2e2213592) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:35:33 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-749a093f-d0ed-411d-96ae-5506c1a14dae tempest-GroupsTest-74115844 None] Created volume successfully. Apr 02 12:35:33 devstack sudo[83960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d1c32ef-e37a-428e-9c0a-22f2a4f242b8 Apr 02 12:35:33 devstack sudo[83960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:34 devstack sudo[83960]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-918cd672-2026-450e-80ea-14c629b02509 tempest-VolumeQuotasNegativeTestJSON-1320183459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d1c32ef-e37a-428e-9c0a-22f2a4f242b8" returned: 0 in 0.607s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-918cd672-2026-450e-80ea-14c629b02509 tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d1c32ef-e37a-428e-9c0a-22f2a4f242b8 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:34 devstack sudo[83965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d1c32ef-e37a-428e-9c0a-22f2a4f242b8 Apr 02 12:35:34 devstack sudo[83965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:34 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:35:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Flow 'volume_create_manager' (4294acbf-582a-4e5a-a101-1b3d239629f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:35:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7cc2bd-ced8-4e61-b35a-5c328d73a21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7cc2bd-ced8-4e61-b35a-5c328d73a21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-349974632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7a050e30-4d04-4e66-adc5-2d0e65a6623c,host='devstack@QuobyteHD#QuobyteHD',id=cb75f288-a965-4c09-ac5d-05bd7c6ff190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='380578f7c37d40b9adf8877619a15256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:35:35Z,use_quota=True,user_id='a2bcf64c063e4b8285b890c7cd7833ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e267e6d-d118-4beb-ba52-2a2376f065ee),volume_type_id=4e267e6d-d118-4beb-ba52-2a2376f065ee)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20cfc30d-d3d2-4358-9033-ffdbd38a353c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20cfc30d-d3d2-4358-9033-ffdbd38a353c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d6fdf7-c092-4c5a-9f66-1cc40679bf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d6fdf7-c092-4c5a-9f66-1cc40679bf42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb75f288-a965-4c09-ac5d-05bd7c6ff190', 'volume_name': 'volume-cb75f288-a965-4c09-ac5d-05bd7c6ff190', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c136f11-fc17-4927-8240-4f256a1b501b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c136f11-fc17-4927-8240-4f256a1b501b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca8c4378-96d3-4acc-8e28-d32b7c2564bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:34 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Volume cb75f288-a965-4c09-ac5d-05bd7c6ff190: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb75f288-a965-4c09-ac5d-05bd7c6ff190', 'volume_size': 1} Apr 02 12:35:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7a050e30-4d04-4e66-adc5-2d0e65a6623c,created_at=2026-04-02T10:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-349974632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7a050e30-4d04-4e66-adc5-2d0e65a6623c,host='devstack@QuobyteHD#QuobyteHD',id=cb75f288-a965-4c09-ac5d-05bd7c6ff190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='380578f7c37d40b9adf8877619a15256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:35:35Z,use_quota=True,user_id='a2bcf64c063e4b8285b890c7cd7833ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e267e6d-d118-4beb-ba52-2a2376f065ee),volume_type_id=4e267e6d-d118-4beb-ba52-2a2376f065ee)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:35:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Creating volume cb75f288-a965-4c09-ac5d-05bd7c6ff190 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:35:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:35:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:35:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:35:34 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:35:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cb75f288-a965-4c09-ac5d-05bd7c6ff190 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:34 devstack sudo[83967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cb75f288-a965-4c09-ac5d-05bd7c6ff190 1073741824 Apr 02 12:35:34 devstack sudo[83967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:34 devstack sudo[83965]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-918cd672-2026-450e-80ea-14c629b02509 tempest-VolumeQuotasNegativeTestJSON-1320183459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6d1c32ef-e37a-428e-9c0a-22f2a4f242b8" returned: 0 in 0.500s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-918cd672-2026-450e-80ea-14c629b02509 tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Lock "cinder-quobyte-6d1c32ef-e37a-428e-9c0a-22f2a4f242b8" released by "delete_volume" :: held 1.141s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:35:35 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-918cd672-2026-450e-80ea-14c629b02509 tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Created reservations ['cc51e9cf-6cdb-44fb-809f-0bfbd5352fb6', '1782809f-5cbc-48b9-a0af-0d6563c2dfdd', '84d98062-a1c6-4ac6-b753-725b857a696a', 'c2abd9d0-1683-4b33-9bcd-3d8415ff57b7'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:35:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-918cd672-2026-450e-80ea-14c629b02509 tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-918cd672-2026-450e-80ea-14c629b02509 tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:35 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-918cd672-2026-450e-80ea-14c629b02509 tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:35:35 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-918cd672-2026-450e-80ea-14c629b02509 tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:35:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-918cd672-2026-450e-80ea-14c629b02509 tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-918cd672-2026-450e-80ea-14c629b02509 tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:35 devstack sudo[83970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:35:35 devstack sudo[83970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:35 devstack sudo[83967]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cb75f288-a965-4c09-ac5d-05bd7c6ff190 1073741824" returned: 0 in 0.610s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cb75f288-a965-4c09-ac5d-05bd7c6ff190 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:35 devstack sudo[83975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cb75f288-a965-4c09-ac5d-05bd7c6ff190 Apr 02 12:35:35 devstack sudo[83975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:35 devstack sudo[83970]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-918cd672-2026-450e-80ea-14c629b02509 tempest-VolumeQuotasNegativeTestJSON-1320183459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.616s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:35 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-918cd672-2026-450e-80ea-14c629b02509 tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:35:35 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-918cd672-2026-450e-80ea-14c629b02509 tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Deleted volume successfully. Apr 02 12:35:35 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-918cd672-2026-450e-80ea-14c629b02509 tempest-VolumeQuotasNegativeTestJSON-1320183459 None] Lock "cinder-6d1c32ef-e37a-428e-9c0a-22f2a4f242b8-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:35:35 devstack sudo[83975]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cb75f288-a965-4c09-ac5d-05bd7c6ff190" returned: 0 in 0.601s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:35 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:35:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:35 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca8c4378-96d3-4acc-8e28-d32b7c2564bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb75f288-a965-4c09-ac5d-05bd7c6ff190', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:35 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd4453f-47bf-483b-8735-7a3b569ed9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:35 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Volume volume-cb75f288-a965-4c09-ac5d-05bd7c6ff190 (cb75f288-a965-4c09-ac5d-05bd7c6ff190): created successfully Apr 02 12:35:35 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd4453f-47bf-483b-8735-7a3b569ed9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:35 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Flow 'volume_create_manager' (4294acbf-582a-4e5a-a101-1b3d239629f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:35:35 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-318e9146-afa0-4ab3-b246-0dfdeec531d5 tempest-GroupsTest-74115844 None] Created volume successfully. Apr 02 12:35:36 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-f52327af-7799-4a2f-85f2-87ad9d1b76df tempest-GroupsTest-74115844 None] Update group completed successfully. Apr 02 12:35:38 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-5b684760-1c47-442f-8c06-2c2727670e6f tempest-GroupsTest-74115844 None] Update group completed successfully. Apr 02 12:35:38 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:35:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Flow 'volume_create_manager' (d741d3ab-c925-422c-ab77-ffabef4671a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:35:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95da8e66-7d6f-4ed7-bb94-741f54c2de4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95da8e66-7d6f-4ed7-bb94-741f54c2de4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:35:38Z,deleted=False,deleted_at=None,display_description='',display_name='3b61a080-612c-4f09-9d3c-5edb0238687a-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0567e477-2e04-4d12-93a5-5604470b788c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f0ed1bf7fd54798a72424291db25f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:35:39Z,use_quota=True,user_id='1afcac2ffd6e486cb8119f1fbe58eb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (330bcc14-b9b4-469e-bf91-5e573b4213e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (330bcc14-b9b4-469e-bf91-5e573b4213e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e925c0b-0953-42b0-96ac-2ce8310bbc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e925c0b-0953-42b0-96ac-2ce8310bbc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0567e477-2e04-4d12-93a5-5604470b788c', 'volume_name': 'volume-0567e477-2e04-4d12-93a5-5604470b788c', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a46f1298-2a18-4ff9-b77c-91429ad3b517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a46f1298-2a18-4ff9-b77c-91429ad3b517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ce14e9-f7bd-410b-a1fd-7704715949ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:38 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Volume 0567e477-2e04-4d12-93a5-5604470b788c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0567e477-2e04-4d12-93a5-5604470b788c', 'volume_size': 1} Apr 02 12:35:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:35:38Z,deleted=False,deleted_at=None,display_description='',display_name='3b61a080-612c-4f09-9d3c-5edb0238687a-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0567e477-2e04-4d12-93a5-5604470b788c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f0ed1bf7fd54798a72424291db25f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:35:39Z,use_quota=True,user_id='1afcac2ffd6e486cb8119f1fbe58eb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:35:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Creating volume 0567e477-2e04-4d12-93a5-5604470b788c {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:35:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:35:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:35:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:35:38 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:35:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0567e477-2e04-4d12-93a5-5604470b788c 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:38 devstack sudo[83982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0567e477-2e04-4d12-93a5-5604470b788c 1073741824 Apr 02 12:35:38 devstack sudo[83982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:39 devstack sudo[83982]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0567e477-2e04-4d12-93a5-5604470b788c 1073741824" returned: 0 in 0.759s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0567e477-2e04-4d12-93a5-5604470b788c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:39 devstack sudo[83987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0567e477-2e04-4d12-93a5-5604470b788c Apr 02 12:35:39 devstack sudo[83987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:39 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-9239e705-072e-4c5c-b979-fdd33ae35cb9 tempest-GroupsTest-74115844 None] Acquiring lock "cinder-quobyte-7f57a31f-0cb6-458a-9201-94fae23883e6" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:35:39 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-9239e705-072e-4c5c-b979-fdd33ae35cb9 tempest-GroupsTest-74115844 None] Lock "cinder-quobyte-7f57a31f-0cb6-458a-9201-94fae23883e6" acquired by "delete_volume" :: waited 0.021s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:35:39 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[b851f1a9-6d62-49bc-a9a4-c02c5cfc1c9b]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:35:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9239e705-072e-4c5c-b979-fdd33ae35cb9 tempest-GroupsTest-74115844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7f57a31f-0cb6-458a-9201-94fae23883e6 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:39 devstack sudo[83989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7f57a31f-0cb6-458a-9201-94fae23883e6 Apr 02 12:35:39 devstack sudo[83989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:40 devstack sudo[83987]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0567e477-2e04-4d12-93a5-5604470b788c" returned: 0 in 0.918s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:40 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:35:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:40 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ce14e9-f7bd-410b-a1fd-7704715949ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0567e477-2e04-4d12-93a5-5604470b788c', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:40 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (411f1343-32e6-44cd-ad1c-92a8c586db2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:40 devstack sudo[83989]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9239e705-072e-4c5c-b979-fdd33ae35cb9 tempest-GroupsTest-74115844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7f57a31f-0cb6-458a-9201-94fae23883e6" returned: 0 in 0.797s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9239e705-072e-4c5c-b979-fdd33ae35cb9 tempest-GroupsTest-74115844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7f57a31f-0cb6-458a-9201-94fae23883e6 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:40 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Volume volume-0567e477-2e04-4d12-93a5-5604470b788c (0567e477-2e04-4d12-93a5-5604470b788c): created successfully Apr 02 12:35:40 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (411f1343-32e6-44cd-ad1c-92a8c586db2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:40 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Flow 'volume_create_manager' (d741d3ab-c925-422c-ab77-ffabef4671a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:35:40 devstack sudo[83995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7f57a31f-0cb6-458a-9201-94fae23883e6 Apr 02 12:35:40 devstack sudo[83995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:40 devstack cinder-volume[82819]: INFO cinder.volume.manager [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-f3e54da3-b1ae-4f4f-9123-f682d35ea559 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Created volume successfully. Apr 02 12:35:41 devstack sudo[83995]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9239e705-072e-4c5c-b979-fdd33ae35cb9 tempest-GroupsTest-74115844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7f57a31f-0cb6-458a-9201-94fae23883e6" returned: 0 in 0.762s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:41 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-9239e705-072e-4c5c-b979-fdd33ae35cb9 tempest-GroupsTest-74115844 None] Lock "cinder-quobyte-7f57a31f-0cb6-458a-9201-94fae23883e6" released by "delete_volume" :: held 1.593s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:35:41 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-9239e705-072e-4c5c-b979-fdd33ae35cb9 tempest-GroupsTest-74115844 None] Acquiring lock "cinder-quobyte-cb75f288-a965-4c09-ac5d-05bd7c6ff190" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:35:41 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-9239e705-072e-4c5c-b979-fdd33ae35cb9 tempest-GroupsTest-74115844 None] Lock "cinder-quobyte-cb75f288-a965-4c09-ac5d-05bd7c6ff190" acquired by "delete_volume" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:35:41 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d5ad47-ff02-47dc-bad1-0fa32eabc3aa]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:35:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9239e705-072e-4c5c-b979-fdd33ae35cb9 tempest-GroupsTest-74115844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cb75f288-a965-4c09-ac5d-05bd7c6ff190 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:41 devstack sudo[84006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cb75f288-a965-4c09-ac5d-05bd7c6ff190 Apr 02 12:35:41 devstack sudo[84006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:42 devstack sudo[84006]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9239e705-072e-4c5c-b979-fdd33ae35cb9 tempest-GroupsTest-74115844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cb75f288-a965-4c09-ac5d-05bd7c6ff190" returned: 0 in 0.983s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9239e705-072e-4c5c-b979-fdd33ae35cb9 tempest-GroupsTest-74115844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cb75f288-a965-4c09-ac5d-05bd7c6ff190 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:42 devstack sudo[84016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cb75f288-a965-4c09-ac5d-05bd7c6ff190 Apr 02 12:35:42 devstack sudo[84016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:43 devstack sudo[84016]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9239e705-072e-4c5c-b979-fdd33ae35cb9 tempest-GroupsTest-74115844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cb75f288-a965-4c09-ac5d-05bd7c6ff190" returned: 0 in 0.861s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:43 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-9239e705-072e-4c5c-b979-fdd33ae35cb9 tempest-GroupsTest-74115844 None] Lock "cinder-quobyte-cb75f288-a965-4c09-ac5d-05bd7c6ff190" released by "delete_volume" :: held 1.889s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:35:43 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-9239e705-072e-4c5c-b979-fdd33ae35cb9 tempest-GroupsTest-74115844 None] Created reservations ['318db541-ce52-4896-9441-2430f9c454b5'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:35:43 devstack cinder-volume[82819]: WARNING cinder.quota [None req-9239e705-072e-4c5c-b979-fdd33ae35cb9 tempest-GroupsTest-74115844 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-853535309 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-853535309, it is now deprecated. Please use the default quota class for default quota. Apr 02 12:35:43 devstack cinder-volume[82819]: WARNING cinder.quota [None req-9239e705-072e-4c5c-b979-fdd33ae35cb9 tempest-GroupsTest-74115844 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-853535309 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-853535309, it is now deprecated. Please use the default quota class for default quota. Apr 02 12:35:43 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-9239e705-072e-4c5c-b979-fdd33ae35cb9 tempest-GroupsTest-74115844 None] Created reservations ['2d6f8229-95ce-4fc8-bfe4-dba47ffa34ce', '50b2b7e5-85c4-44cd-965c-0127170154d9', '92933b10-60f3-477c-bad1-fb123d0ee656', '075c4a1c-1fe0-4772-896b-b08c9878d29c'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:35:43 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-9239e705-072e-4c5c-b979-fdd33ae35cb9 tempest-GroupsTest-74115844 None] Created reservations ['b4892db2-ec44-47ad-9a73-b9e364ba70ba', '96e7e5a4-518b-487c-b8ff-f971f60ad9c8', '1c16d8cb-259b-41b1-9f9d-8e5ce5fe44dc', '1d40ee96-9e6c-4a0d-90d7-4ffca9217e21'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:35:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9239e705-072e-4c5c-b979-fdd33ae35cb9 tempest-GroupsTest-74115844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9239e705-072e-4c5c-b979-fdd33ae35cb9 tempest-GroupsTest-74115844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:43 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9239e705-072e-4c5c-b979-fdd33ae35cb9 tempest-GroupsTest-74115844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:35:43 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9239e705-072e-4c5c-b979-fdd33ae35cb9 tempest-GroupsTest-74115844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:35:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9239e705-072e-4c5c-b979-fdd33ae35cb9 tempest-GroupsTest-74115844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9239e705-072e-4c5c-b979-fdd33ae35cb9 tempest-GroupsTest-74115844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:44 devstack sudo[84035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:35:44 devstack sudo[84035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:44 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:35:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Flow 'volume_create_manager' (c060911d-5046-4cea-b5b3-0c5fed11cdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:35:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e2b18f-daa6-4a10-b7b6-5de3c1c2ec64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e2b18f-daa6-4a10-b7b6-5de3c1c2ec64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-759512707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=712d7b39-0508-4fcc-825d-b9658dccd0e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5d7da6b59174b28bc377ef236b94705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:35:44Z,use_quota=True,user_id='8cc2b36d1d194baab07fad926900166b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2962538d-4955-44fc-95a1-ed16d5b92f41),volume_type_id=2962538d-4955-44fc-95a1-ed16d5b92f41)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25442a79-277a-46e4-b472-5fa6ad627340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25442a79-277a-46e4-b472-5fa6ad627340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a73405d4-f423-48e8-9424-301373f33e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a73405d4-f423-48e8-9424-301373f33e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '712d7b39-0508-4fcc-825d-b9658dccd0e0', 'volume_name': 'volume-712d7b39-0508-4fcc-825d-b9658dccd0e0', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eee1ce0-3373-44be-8cc2-45373445b4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eee1ce0-3373-44be-8cc2-45373445b4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b239a3b7-769b-4699-b639-69eb4f438aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:44 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Volume 712d7b39-0508-4fcc-825d-b9658dccd0e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-712d7b39-0508-4fcc-825d-b9658dccd0e0', 'volume_size': 1} Apr 02 12:35:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:44 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-759512707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=712d7b39-0508-4fcc-825d-b9658dccd0e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5d7da6b59174b28bc377ef236b94705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:35:44Z,use_quota=True,user_id='8cc2b36d1d194baab07fad926900166b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2962538d-4955-44fc-95a1-ed16d5b92f41),volume_type_id=2962538d-4955-44fc-95a1-ed16d5b92f41)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:35:44 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Creating volume 712d7b39-0508-4fcc-825d-b9658dccd0e0 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:35:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:44 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:35:44 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:35:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:44 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:35:44 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:35:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-712d7b39-0508-4fcc-825d-b9658dccd0e0 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:44 devstack sudo[84045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-712d7b39-0508-4fcc-825d-b9658dccd0e0 1073741824 Apr 02 12:35:44 devstack sudo[84045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:44 devstack sudo[84035]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9239e705-072e-4c5c-b979-fdd33ae35cb9 tempest-GroupsTest-74115844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.969s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:44 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-9239e705-072e-4c5c-b979-fdd33ae35cb9 tempest-GroupsTest-74115844 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:35:44 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-9239e705-072e-4c5c-b979-fdd33ae35cb9 tempest-GroupsTest-74115844 None] Delete group completed successfully. Apr 02 12:35:45 devstack cinder-volume[82819]: WARNING py.warnings [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-db584684-6bb2-4478-bd62-8dc610b607d4 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 02 12:35:45 devstack cinder-volume[82819]: .first() Apr 02 12:35:45 devstack cinder-volume[82819]: Apr 02 12:35:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-db584684-6bb2-4478-bd62-8dc610b607d4 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:45 devstack sudo[84045]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-712d7b39-0508-4fcc-825d-b9658dccd0e0 1073741824" returned: 0 in 0.945s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-712d7b39-0508-4fcc-825d-b9658dccd0e0 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:45 devstack sudo[84053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-712d7b39-0508-4fcc-825d-b9658dccd0e0 Apr 02 12:35:45 devstack sudo[84053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:46 devstack sudo[84053]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-712d7b39-0508-4fcc-825d-b9658dccd0e0" returned: 0 in 0.541s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:46 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:35:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-db584684-6bb2-4478-bd62-8dc610b607d4 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.132s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:46 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b239a3b7-769b-4699-b639-69eb4f438aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-712d7b39-0508-4fcc-825d-b9658dccd0e0', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:46 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41ad2130-adef-4e26-9121-db6331206464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:35:46 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[3952d0f7-84b9-4113-958d-dacf1899e40d]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:35:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-db584684-6bb2-4478-bd62-8dc610b607d4 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0567e477-2e04-4d12-93a5-5604470b788c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:46 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Volume volume-712d7b39-0508-4fcc-825d-b9658dccd0e0 (712d7b39-0508-4fcc-825d-b9658dccd0e0): created successfully Apr 02 12:35:46 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41ad2130-adef-4e26-9121-db6331206464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:35:46 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Flow 'volume_create_manager' (c060911d-5046-4cea-b5b3-0c5fed11cdea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:35:46 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-9186b111-2f23-4dfc-9d96-ccf7d25c6e20 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Created volume successfully. Apr 02 12:35:46 devstack sudo[84056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0567e477-2e04-4d12-93a5-5604470b788c Apr 02 12:35:46 devstack sudo[84056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:47 devstack sudo[84056]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-db584684-6bb2-4478-bd62-8dc610b607d4 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0567e477-2e04-4d12-93a5-5604470b788c" returned: 0 in 1.093s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-db584684-6bb2-4478-bd62-8dc610b607d4 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.122s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-db584684-6bb2-4478-bd62-8dc610b607d4 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea', 'name': 'volume-0567e477-2e04-4d12-93a5-5604470b788c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06d31521-b1df-4a34-9962-a4a85de4e9f8', 'enforce_multipath': True} {{(pid=82819) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 02 12:35:47 devstack cinder-volume[82819]: INFO cinder.volume.manager [req-c4f3798a-c91c-4332-8096-af951bd9b8be req-db584684-6bb2-4478-bd62-8dc610b607d4 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] attachment_update completed successfully. Apr 02 12:35:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e29aa1ac-bbe5-4f45-aa24-3704a4c5d9d9 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e29aa1ac-bbe5-4f45-aa24-3704a4c5d9d9 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:47 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e29aa1ac-bbe5-4f45-aa24-3704a4c5d9d9 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:35:47 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e29aa1ac-bbe5-4f45-aa24-3704a4c5d9d9 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:35:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e29aa1ac-bbe5-4f45-aa24-3704a4c5d9d9 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e29aa1ac-bbe5-4f45-aa24-3704a4c5d9d9 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:47 devstack sudo[84062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:35:47 devstack sudo[84062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:48 devstack sudo[84062]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e29aa1ac-bbe5-4f45-aa24-3704a4c5d9d9 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.676s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:48 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-e29aa1ac-bbe5-4f45-aa24-3704a4c5d9d9 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:35:48 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-e29aa1ac-bbe5-4f45-aa24-3704a4c5d9d9 tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Retype volume completed successfully. Apr 02 12:35:48 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1a8f739c-c262-4a1e-a13c-8eed94573a0d tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Acquiring lock "cinder-712d7b39-0508-4fcc-825d-b9658dccd0e0-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:35:48 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1a8f739c-c262-4a1e-a13c-8eed94573a0d tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Lock "cinder-712d7b39-0508-4fcc-825d-b9658dccd0e0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:35:48 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:SELECT=131,cinder:UPDATE=142,cinder:INSERT=31,cinder:DELETE=7 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:35:48 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1a8f739c-c262-4a1e-a13c-8eed94573a0d tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Acquiring lock "cinder-quobyte-712d7b39-0508-4fcc-825d-b9658dccd0e0" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:35:48 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1a8f739c-c262-4a1e-a13c-8eed94573a0d tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Lock "cinder-quobyte-712d7b39-0508-4fcc-825d-b9658dccd0e0" acquired by "delete_volume" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:35:48 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e811d4-7a59-4146-b40e-a57dcb12f7f2]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:35:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1a8f739c-c262-4a1e-a13c-8eed94573a0d tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-712d7b39-0508-4fcc-825d-b9658dccd0e0 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:49 devstack sudo[84072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-712d7b39-0508-4fcc-825d-b9658dccd0e0 Apr 02 12:35:49 devstack sudo[84072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:49 devstack sudo[84072]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1a8f739c-c262-4a1e-a13c-8eed94573a0d tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-712d7b39-0508-4fcc-825d-b9658dccd0e0" returned: 0 in 0.777s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1a8f739c-c262-4a1e-a13c-8eed94573a0d tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-712d7b39-0508-4fcc-825d-b9658dccd0e0 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:49 devstack sudo[84077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-712d7b39-0508-4fcc-825d-b9658dccd0e0 Apr 02 12:35:49 devstack sudo[84077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:50 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-c7740e4f-154d-4f0c-af89-a86942d7455a tempest-GroupsV320Test-2048060093 None] Group tempest-GroupsV320Test-Group-819081002: creating Apr 02 12:35:50 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:SELECT=128,cinder:UPDATE=122,cinder:INSERT=23,cinder:DELETE=4 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:35:50 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-c7740e4f-154d-4f0c-af89-a86942d7455a tempest-GroupsV320Test-2048060093 None] Group tempest-GroupsV320Test-Group-819081002: created successfully Apr 02 12:35:50 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-c7740e4f-154d-4f0c-af89-a86942d7455a tempest-GroupsV320Test-2048060093 None] Create group completed successfully. Apr 02 12:35:50 devstack sudo[84077]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1a8f739c-c262-4a1e-a13c-8eed94573a0d tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-712d7b39-0508-4fcc-825d-b9658dccd0e0" returned: 0 in 0.706s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:50 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1a8f739c-c262-4a1e-a13c-8eed94573a0d tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Lock "cinder-quobyte-712d7b39-0508-4fcc-825d-b9658dccd0e0" released by "delete_volume" :: held 1.525s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:35:50 devstack cinder-volume[82819]: WARNING cinder.quota [None req-1a8f739c-c262-4a1e-a13c-8eed94573a0d tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 02 12:35:50 devstack cinder-volume[82819]: WARNING cinder.quota [None req-1a8f739c-c262-4a1e-a13c-8eed94573a0d tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 02 12:35:50 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-1a8f739c-c262-4a1e-a13c-8eed94573a0d tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Created reservations ['6e1c8f98-001f-43e1-89d0-de964ec310b2', '87774ef2-3bcc-490f-905f-c1f8cada3000', 'f95609d9-ca32-4ff0-8b65-fe4356fc6781', 'e1476d1a-3cfd-4f7c-a0f8-518554539f81'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:35:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-1a8f739c-c262-4a1e-a13c-8eed94573a0d tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-1a8f739c-c262-4a1e-a13c-8eed94573a0d tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-1a8f739c-c262-4a1e-a13c-8eed94573a0d tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:35:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-1a8f739c-c262-4a1e-a13c-8eed94573a0d tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:35:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-1a8f739c-c262-4a1e-a13c-8eed94573a0d tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1a8f739c-c262-4a1e-a13c-8eed94573a0d tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:50 devstack sudo[84148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:35:50 devstack sudo[84148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:51 devstack sudo[84148]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1a8f739c-c262-4a1e-a13c-8eed94573a0d tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.558s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:51 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-1a8f739c-c262-4a1e-a13c-8eed94573a0d tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:35:51 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-1a8f739c-c262-4a1e-a13c-8eed94573a0d tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Deleted volume successfully. Apr 02 12:35:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1a8f739c-c262-4a1e-a13c-8eed94573a0d tempest-VolumeRetypeWithoutMigrationTest-1560566744 None] Lock "cinder-712d7b39-0508-4fcc-825d-b9658dccd0e0-delete_volume" released by "delete_volume" :: held 2.311s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:35:51 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-cef13863-ddf8-4147-8153-d480f4fe5233 tempest-GroupsV320Test-2048060093 None] Created reservations ['0d17feaa-5c60-4c85-9371-642275838d72'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:35:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cef13863-ddf8-4147-8153-d480f4fe5233 tempest-GroupsV320Test-2048060093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:35:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cef13863-ddf8-4147-8153-d480f4fe5233 tempest-GroupsV320Test-2048060093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:35:51 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cef13863-ddf8-4147-8153-d480f4fe5233 tempest-GroupsV320Test-2048060093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:35:51 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cef13863-ddf8-4147-8153-d480f4fe5233 tempest-GroupsV320Test-2048060093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:35:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cef13863-ddf8-4147-8153-d480f4fe5233 tempest-GroupsV320Test-2048060093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:35:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cef13863-ddf8-4147-8153-d480f4fe5233 tempest-GroupsV320Test-2048060093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:35:51 devstack sudo[84154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:35:51 devstack sudo[84154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:35:52 devstack sudo[84154]: pam_unix(sudo:session): session closed for user root Apr 02 12:35:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cef13863-ddf8-4147-8153-d480f4fe5233 tempest-GroupsV320Test-2048060093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.592s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:35:52 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-cef13863-ddf8-4147-8153-d480f4fe5233 tempest-GroupsV320Test-2048060093 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:35:52 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-cef13863-ddf8-4147-8153-d480f4fe5233 tempest-GroupsV320Test-2048060093 None] Delete group completed successfully. Apr 02 12:36:00 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:36:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Flow 'volume_create_manager' (adad85e3-1347-4400-b004-2ee0be2202de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:36:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7868e06-339f-4860-81e7-28a2bf39010f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7868e06-339f-4860-81e7-28a2bf39010f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1330784755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e92a5d03-adda-45a5-ba78-d2fd1fa8487c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5828458766fd48c18a33ac09e063a8b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:36:01Z,use_quota=True,user_id='10c94bb57cb74d9c9fd529711f7bf4a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b9caa0-e589-41d2-b58d-61026ed65171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b9caa0-e589-41d2-b58d-61026ed65171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d66228d4-4058-43dc-b5b5-57a3379045c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:00 devstack cinder-volume[82819]: DEBUG cinder.image.glance [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Creating Keystone auth plugin from conf {{(pid=82819) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 02 12:36:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d66228d4-4058-43dc-b5b5-57a3379045c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e92a5d03-adda-45a5-ba78-d2fd1fa8487c', 'volume_name': 'volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c', 'volume_size': 1, 'image_id': '361107cd-f0bc-4798-a524-aa6f2b337172', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/361107cd-f0bc-4798-a524-aa6f2b337172', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd668ace29fed46e98c54f346600c750f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '361107cd-f0bc-4798-a524-aa6f2b337172', 'created_at': datetime.datetime(2026, 4, 2, 10, 29, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 10, 29, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/361107cd-f0bc-4798-a524-aa6f2b337172/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bc91398-93bf-442a-9e78-2fedb9259bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bc91398-93bf-442a-9e78-2fedb9259bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab073fa9-9da5-4e63-a945-024d26fc7733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:01 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Volume e92a5d03-adda-45a5-ba78-d2fd1fa8487c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c', 'volume_size': 1, 'image_id': '361107cd-f0bc-4798-a524-aa6f2b337172', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/361107cd-f0bc-4798-a524-aa6f2b337172', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd668ace29fed46e98c54f346600c750f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '361107cd-f0bc-4798-a524-aa6f2b337172', 'created_at': datetime.datetime(2026, 4, 2, 10, 29, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 10, 29, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/361107cd-f0bc-4798-a524-aa6f2b337172/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 02 12:36:01 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Trying to clone e92a5d03-adda-45a5-ba78-d2fd1fa8487c from image 361107cd-f0bc-4798-a524-aa6f2b337172 at location (None, [{'url': 'file:///opt/stack/data/glance/images/361107cd-f0bc-4798-a524-aa6f2b337172', 'metadata': {}}]). {{(pid=82819) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 02 12:36:01 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_lmj8a7kudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82819) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 02 12:36:01 devstack cinder-volume[82819]: INFO cinder.image.image_utils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Image download 20.69 MB at 20.69 MB/s Apr 02 12:36:01 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7ecc95-be42-432c-bd3d-73221cd2a977]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:36:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_lmj8a7kudevstack@QuobyteHD {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:01 devstack sudo[84614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_lmj8a7kudevstack@QuobyteHD Apr 02 12:36:01 devstack sudo[84614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:02 devstack sudo[84614]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_lmj8a7kudevstack@QuobyteHD" returned: 0 in 0.613s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:02 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Temporary image 361107cd-f0bc-4798-a524-aa6f2b337172 is fetched for user 10c94bb57cb74d9c9fd529711f7bf4a5. {{(pid=82819) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 02 12:36:02 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7786ce8d-6a08-4c72-b524-816474192fef]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:36:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_lmj8a7kudevstack@QuobyteHD {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:02 devstack sudo[84620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_lmj8a7kudevstack@QuobyteHD Apr 02 12:36:02 devstack sudo[84620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:03 devstack sudo[84620]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_lmj8a7kudevstack@QuobyteHD" returned: 0 in 0.860s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:36:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:36:03 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1330784755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e92a5d03-adda-45a5-ba78-d2fd1fa8487c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5828458766fd48c18a33ac09e063a8b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:36:01Z,use_quota=True,user_id='10c94bb57cb74d9c9fd529711f7bf4a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:36:03 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Creating volume e92a5d03-adda-45a5-ba78-d2fd1fa8487c {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:36:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:36:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:36:03 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:36:03 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:36:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:36:03 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:36:03 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:36:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:03 devstack sudo[84646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c 1073741824 Apr 02 12:36:03 devstack sudo[84646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:03 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:36:03 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Flow 'volume_create_manager' (03e2e30d-af33-4bbf-b232-775fd6eca0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:36:03 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d22b30c-9ce3-4444-aab2-9e9317f03e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:03 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d22b30c-9ce3-4444-aab2-9e9317f03e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-853726872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69b3119-ca1f-45de-9be6-a9b288479df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='defc311e147d47bea9dbf2c074efc070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:36:04Z,use_quota=True,user_id='99cd600f3e044165abae7a47b5a99f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:03 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c86a01c-cfaf-483e-9c5c-353a57741fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:03 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c86a01c-cfaf-483e-9c5c-353a57741fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:03 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4caac10a-6345-424c-9b95-03e927c4d263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:03 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4caac10a-6345-424c-9b95-03e927c4d263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b69b3119-ca1f-45de-9be6-a9b288479df5', 'volume_name': 'volume-b69b3119-ca1f-45de-9be6-a9b288479df5', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:03 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a274e1-9b25-4df9-af9e-e8ea7fb2950f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:03 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a274e1-9b25-4df9-af9e-e8ea7fb2950f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:03 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b76519-2fe9-424e-947f-b85c8e0199b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:03 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Volume b69b3119-ca1f-45de-9be6-a9b288479df5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b69b3119-ca1f-45de-9be6-a9b288479df5', 'volume_size': 1} Apr 02 12:36:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:36:04 devstack sudo[84646]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c 1073741824" returned: 0 in 0.976s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:04 devstack sudo[84653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c Apr 02 12:36:04 devstack sudo[84653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:05 devstack sudo[84653]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c" returned: 0 in 0.592s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:05 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:36:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:36:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.207s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:36:05 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-853726872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69b3119-ca1f-45de-9be6-a9b288479df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='defc311e147d47bea9dbf2c074efc070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:36:04Z,use_quota=True,user_id='99cd600f3e044165abae7a47b5a99f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:36:05 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Creating volume b69b3119-ca1f-45de-9be6-a9b288479df5 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:36:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:36:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:36:05 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:36:05 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:36:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:36:05 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:36:05 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:36:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b69b3119-ca1f-45de-9be6-a9b288479df5 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:05 devstack sudo[84690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b69b3119-ca1f-45de-9be6-a9b288479df5 1073741824 Apr 02 12:36:05 devstack cinder-volume[82819]: DEBUG cinder.volume.volume_utils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Attempting download of 361107cd-f0bc-4798-a524-aa6f2b337172 ((None, [{'url': 'file:///opt/stack/data/glance/images/361107cd-f0bc-4798-a524-aa6f2b337172', 'metadata': {}}])) to volume e92a5d03-adda-45a5-ba78-d2fd1fa8487c. {{(pid=82819) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 02 12:36:05 devstack sudo[84690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:05 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fa0ccb-6452-4c4d-acf0-65acb82a179d]: (4, 'raw') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:36:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_361107cd-f0bc-4798-a524-aa6f2b337172_oxhnloxb {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:05 devstack sudo[84694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_361107cd-f0bc-4798-a524-aa6f2b337172_oxhnloxb Apr 02 12:36:05 devstack sudo[84694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:05 devstack sudo[84694]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_361107cd-f0bc-4798-a524-aa6f2b337172_oxhnloxb" returned: 0 in 0.731s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_361107cd-f0bc-4798-a524-aa6f2b337172_oxhnloxb {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:06 devstack sudo[84690]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b69b3119-ca1f-45de-9be6-a9b288479df5 1073741824" returned: 0 in 0.902s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b69b3119-ca1f-45de-9be6-a9b288479df5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:06 devstack sudo[84704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_361107cd-f0bc-4798-a524-aa6f2b337172_oxhnloxb Apr 02 12:36:06 devstack sudo[84704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:06 devstack sudo[84705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b69b3119-ca1f-45de-9be6-a9b288479df5 Apr 02 12:36:06 devstack sudo[84705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:06 devstack sudo[84705]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b69b3119-ca1f-45de-9be6-a9b288479df5" returned: 0 in 0.519s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:06 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:36:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:36:06 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b76519-2fe9-424e-947f-b85c8e0199b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b69b3119-ca1f-45de-9be6-a9b288479df5', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:06 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b483e6-5f07-492a-8508-8b27c7efe4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:06 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Volume volume-b69b3119-ca1f-45de-9be6-a9b288479df5 (b69b3119-ca1f-45de-9be6-a9b288479df5): created successfully Apr 02 12:36:06 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b483e6-5f07-492a-8508-8b27c7efe4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:06 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Flow 'volume_create_manager' (03e2e30d-af33-4bbf-b232-775fd6eca0ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:36:06 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-20741de0-c827-414c-8f27-193c1c12e22e tempest-DeleteServersTestJSON-1683612875 None] Created volume successfully. Apr 02 12:36:06 devstack sudo[84704]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_361107cd-f0bc-4798-a524-aa6f2b337172_oxhnloxb" returned: 1 in 0.714s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_361107cd-f0bc-4798-a524-aa6f2b337172_oxhnloxb' failed. Not Retrying. {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 12:36:06 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d858715-7a59-4f2c-848a-ad89243060b6]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:36:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_lmj8a7kudevstack@QuobyteHD {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:06 devstack sudo[84711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_lmj8a7kudevstack@QuobyteHD Apr 02 12:36:06 devstack sudo[84711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:07 devstack sudo[84711]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_lmj8a7kudevstack@QuobyteHD" returned: 0 in 0.592s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:07 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] 361107cd-f0bc-4798-a524-aa6f2b337172 was qcow2, converting to raw {{(pid=82819) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 02 12:36:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_lmj8a7kudevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:07 devstack sudo[84719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_lmj8a7kudevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c Apr 02 12:36:07 devstack sudo[84719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:08 devstack sudo[84719]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_lmj8a7kudevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c" returned: 0 in 1.273s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:08 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_lmj8a7kudevstack@QuobyteHD, size 112.00 MB, duration 1.27 sec, destination /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c {{(pid=82819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 12:36:08 devstack cinder-volume[82819]: INFO cinder.image.image_utils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Converted 112.00 MB image at 87.89 MB/s Apr 02 12:36:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:08 devstack sudo[84744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c 1G Apr 02 12:36:08 devstack sudo[84744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:09 devstack sudo[84744]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c 1G" returned: 0 in 0.507s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:09 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[939e9b7e-5648-49dd-a748-91d8e4e059a6]: (4, 'raw') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:36:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:09 devstack sudo[84749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c Apr 02 12:36:09 devstack sudo[84749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:10 devstack sudo[84749]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c" returned: 0 in 1.291s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:10 devstack sudo[84807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c Apr 02 12:36:10 devstack sudo[84807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:11 devstack sudo[84807]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c" returned: 1 in 0.843s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c' failed. Not Retrying. {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 12:36:11 devstack cinder-volume[82819]: DEBUG cinder.volume.volume_utils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Downloaded image 361107cd-f0bc-4798-a524-aa6f2b337172 ((None, [{'url': 'file:///opt/stack/data/glance/images/361107cd-f0bc-4798-a524-aa6f2b337172', 'metadata': {}}])) to volume e92a5d03-adda-45a5-ba78-d2fd1fa8487c successfully. {{(pid=82819) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 02 12:36:11 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Temporary image 361107cd-f0bc-4798-a524-aa6f2b337172 for user 10c94bb57cb74d9c9fd529711f7bf4a5 is deleted. {{(pid=82819) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 02 12:36:11 devstack cinder-volume[82819]: DEBUG cinder.volume.volume_utils [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Marking volume e92a5d03-adda-45a5-ba78-d2fd1fa8487c as bootable. {{(pid=82819) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 02 12:36:11 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Copying metadata from image 361107cd-f0bc-4798-a524-aa6f2b337172 to e92a5d03-adda-45a5-ba78-d2fd1fa8487c. {{(pid=82819) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 02 12:36:11 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Creating volume glance metadata for volume e92a5d03-adda-45a5-ba78-d2fd1fa8487c backed by image 361107cd-f0bc-4798-a524-aa6f2b337172 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '361107cd-f0bc-4798-a524-aa6f2b337172', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82819) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 02 12:36:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-5b6abc37-2bb3-4234-8cc2-1d7ae748bf4d req-802adafe-2a2a-400c-a691-745375604f96 tempest-DeleteServersTestJSON-1683612875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:36:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-5b6abc37-2bb3-4234-8cc2-1d7ae748bf4d req-802adafe-2a2a-400c-a691-745375604f96 tempest-DeleteServersTestJSON-1683612875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:36:11 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e88ba10-1cf5-4ef9-a5a7-a071be757ab3]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:36:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-5b6abc37-2bb3-4234-8cc2-1d7ae748bf4d req-802adafe-2a2a-400c-a691-745375604f96 tempest-DeleteServersTestJSON-1683612875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b69b3119-ca1f-45de-9be6-a9b288479df5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:11 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab073fa9-9da5-4e63-a945-024d26fc7733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c', 'volume_size': 1, 'image_id': '361107cd-f0bc-4798-a524-aa6f2b337172', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/361107cd-f0bc-4798-a524-aa6f2b337172', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd668ace29fed46e98c54f346600c750f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '361107cd-f0bc-4798-a524-aa6f2b337172', 'created_at': datetime.datetime(2026, 4, 2, 10, 29, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 10, 29, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/361107cd-f0bc-4798-a524-aa6f2b337172/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:11 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (287814bb-a7a0-4351-8f20-198940c781b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:11 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Volume volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c (e92a5d03-adda-45a5-ba78-d2fd1fa8487c): created successfully Apr 02 12:36:11 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (287814bb-a7a0-4351-8f20-198940c781b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:11 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Flow 'volume_create_manager' (adad85e3-1347-4400-b004-2ee0be2202de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:36:11 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-cdbedec1-399a-4bf6-9319-ac7d30324866 tempest-VolumesImageMetadata-1608657584 None] Created volume successfully. Apr 02 12:36:11 devstack sudo[84821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b69b3119-ca1f-45de-9be6-a9b288479df5 Apr 02 12:36:11 devstack sudo[84821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:12 devstack sudo[84821]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-5b6abc37-2bb3-4234-8cc2-1d7ae748bf4d req-802adafe-2a2a-400c-a691-745375604f96 tempest-DeleteServersTestJSON-1683612875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b69b3119-ca1f-45de-9be6-a9b288479df5" returned: 0 in 0.971s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-5b6abc37-2bb3-4234-8cc2-1d7ae748bf4d req-802adafe-2a2a-400c-a691-745375604f96 tempest-DeleteServersTestJSON-1683612875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.020s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:36:12 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-5b6abc37-2bb3-4234-8cc2-1d7ae748bf4d req-802adafe-2a2a-400c-a691-745375604f96 tempest-DeleteServersTestJSON-1683612875 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea', 'name': 'volume-b69b3119-ca1f-45de-9be6-a9b288479df5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b6607213-b1b9-4287-b50d-f4211bf140af', 'enforce_multipath': True} {{(pid=82819) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 02 12:36:12 devstack cinder-volume[82819]: INFO cinder.volume.manager [req-5b6abc37-2bb3-4234-8cc2-1d7ae748bf4d req-802adafe-2a2a-400c-a691-745375604f96 tempest-DeleteServersTestJSON-1683612875 None] attachment_update completed successfully. Apr 02 12:36:12 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-74aa5f5f-2a60-4456-9594-f85dd91638b6 tempest-VolumesImageMetadata-1608657584 None] Acquiring lock "cinder-e92a5d03-adda-45a5-ba78-d2fd1fa8487c-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:36:12 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-74aa5f5f-2a60-4456-9594-f85dd91638b6 tempest-VolumesImageMetadata-1608657584 None] Lock "cinder-e92a5d03-adda-45a5-ba78-d2fd1fa8487c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:36:12 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-74aa5f5f-2a60-4456-9594-f85dd91638b6 tempest-VolumesImageMetadata-1608657584 None] Acquiring lock "cinder-quobyte-e92a5d03-adda-45a5-ba78-d2fd1fa8487c" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:36:12 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-74aa5f5f-2a60-4456-9594-f85dd91638b6 tempest-VolumesImageMetadata-1608657584 None] Lock "cinder-quobyte-e92a5d03-adda-45a5-ba78-d2fd1fa8487c" acquired by "delete_volume" :: waited 0.013s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:36:12 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[974a4f84-4fa0-441d-846a-343288462fe7]: (4, 'raw') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:36:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-74aa5f5f-2a60-4456-9594-f85dd91638b6 tempest-VolumesImageMetadata-1608657584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:12 devstack sudo[84828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c Apr 02 12:36:12 devstack sudo[84828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:13 devstack cinder-volume[82819]: DEBUG oslo_service.periodic_task [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82819) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 12:36:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:36:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:36:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:36:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:36:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:36:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:13 devstack sudo[84830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:36:13 devstack sudo[84830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:13 devstack sudo[84828]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-74aa5f5f-2a60-4456-9594-f85dd91638b6 tempest-VolumesImageMetadata-1608657584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c" returned: 0 in 1.175s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-74aa5f5f-2a60-4456-9594-f85dd91638b6 tempest-VolumesImageMetadata-1608657584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:14 devstack sudo[84838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c Apr 02 12:36:14 devstack sudo[84838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:14 devstack sudo[84830]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 1.109s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:14 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:36:14 devstack sudo[84838]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-74aa5f5f-2a60-4456-9594-f85dd91638b6 tempest-VolumesImageMetadata-1608657584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c" returned: 1 in 0.834s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-74aa5f5f-2a60-4456-9594-f85dd91638b6 tempest-VolumesImageMetadata-1608657584 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c' failed. Not Retrying. {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 12:36:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-74aa5f5f-2a60-4456-9594-f85dd91638b6 tempest-VolumesImageMetadata-1608657584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:14 devstack sudo[84846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c Apr 02 12:36:14 devstack sudo[84846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:15 devstack sudo[84846]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-74aa5f5f-2a60-4456-9594-f85dd91638b6 tempest-VolumesImageMetadata-1608657584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e92a5d03-adda-45a5-ba78-d2fd1fa8487c" returned: 0 in 0.662s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:15 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-74aa5f5f-2a60-4456-9594-f85dd91638b6 tempest-VolumesImageMetadata-1608657584 None] Lock "cinder-quobyte-e92a5d03-adda-45a5-ba78-d2fd1fa8487c" released by "delete_volume" :: held 2.778s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:36:15 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-74aa5f5f-2a60-4456-9594-f85dd91638b6 tempest-VolumesImageMetadata-1608657584 None] Created reservations ['7d17b584-dd64-4317-a536-fbc166e35431', '018f8857-96da-4149-ba6d-40a095392ffa', 'bc509cde-06bd-4f2d-b0e8-ec286e26e619', '0d489921-d455-4cc5-b590-91ecbaf35ce1'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:36:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-74aa5f5f-2a60-4456-9594-f85dd91638b6 tempest-VolumesImageMetadata-1608657584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:36:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-74aa5f5f-2a60-4456-9594-f85dd91638b6 tempest-VolumesImageMetadata-1608657584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:36:15 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-74aa5f5f-2a60-4456-9594-f85dd91638b6 tempest-VolumesImageMetadata-1608657584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:36:15 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-74aa5f5f-2a60-4456-9594-f85dd91638b6 tempest-VolumesImageMetadata-1608657584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:36:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-74aa5f5f-2a60-4456-9594-f85dd91638b6 tempest-VolumesImageMetadata-1608657584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:36:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-74aa5f5f-2a60-4456-9594-f85dd91638b6 tempest-VolumesImageMetadata-1608657584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:15 devstack sudo[84874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:36:15 devstack sudo[84874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:16 devstack sudo[84874]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-74aa5f5f-2a60-4456-9594-f85dd91638b6 tempest-VolumesImageMetadata-1608657584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.729s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:16 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-74aa5f5f-2a60-4456-9594-f85dd91638b6 tempest-VolumesImageMetadata-1608657584 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:36:16 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-74aa5f5f-2a60-4456-9594-f85dd91638b6 tempest-VolumesImageMetadata-1608657584 None] Deleted volume successfully. Apr 02 12:36:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-74aa5f5f-2a60-4456-9594-f85dd91638b6 tempest-VolumesImageMetadata-1608657584 None] Lock "cinder-e92a5d03-adda-45a5-ba78-d2fd1fa8487c-delete_volume" released by "delete_volume" :: held 3.753s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:36:20 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:36:20 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Flow 'volume_create_manager' (0cf8640d-b7f4-449a-9719-ac3b0d8ce043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:36:20 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c82852e-808b-4000-87d4-d6afa9186cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:20 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c82852e-808b-4000-87d4-d6afa9186cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-262779550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=525f346d-44c5-4143-9068-2e4d703b2d60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b154d7bbd78e48269b65103053ae4450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:36:20Z,use_quota=True,user_id='45c0f88bd0484517a8f9b51886a9fb1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:20 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55945459-6b30-4564-9f4b-e40a3262ea28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:20 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55945459-6b30-4564-9f4b-e40a3262ea28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:20 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9db29e-f947-4a9c-a2f7-42c55ad7e1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:20 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9db29e-f947-4a9c-a2f7-42c55ad7e1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '525f346d-44c5-4143-9068-2e4d703b2d60', 'volume_name': 'volume-525f346d-44c5-4143-9068-2e4d703b2d60', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:20 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc58145-5eb6-4fd8-b3af-130655e01107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:20 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc58145-5eb6-4fd8-b3af-130655e01107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:20 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38af4b40-0b51-4bfc-a384-3d9bd3dddcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:20 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Volume 525f346d-44c5-4143-9068-2e4d703b2d60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-525f346d-44c5-4143-9068-2e4d703b2d60', 'volume_size': 1} Apr 02 12:36:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:36:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:36:20 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-262779550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=525f346d-44c5-4143-9068-2e4d703b2d60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b154d7bbd78e48269b65103053ae4450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:36:20Z,use_quota=True,user_id='45c0f88bd0484517a8f9b51886a9fb1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:36:20 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Creating volume 525f346d-44c5-4143-9068-2e4d703b2d60 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:36:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:36:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:36:20 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:36:20 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:36:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:36:20 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:36:20 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:36:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-525f346d-44c5-4143-9068-2e4d703b2d60 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:20 devstack sudo[84936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-525f346d-44c5-4143-9068-2e4d703b2d60 1073741824 Apr 02 12:36:20 devstack sudo[84936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:20 devstack sudo[84936]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-525f346d-44c5-4143-9068-2e4d703b2d60 1073741824" returned: 0 in 0.649s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-525f346d-44c5-4143-9068-2e4d703b2d60 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:20 devstack sudo[84941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-525f346d-44c5-4143-9068-2e4d703b2d60 Apr 02 12:36:20 devstack sudo[84941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:20 devstack cinder-volume[82819]: INFO cinder.volume.manager [req-ab19767b-4538-4a07-9547-bef6daf68897 req-b8f499a7-c094-4174-a45f-f563b42f3d97 tempest-DeleteServersTestJSON-1683612875 None] Terminate volume connection completed successfully. Apr 02 12:36:20 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-ab19767b-4538-4a07-9547-bef6daf68897 req-b8f499a7-c094-4174-a45f-f563b42f3d97 tempest-DeleteServersTestJSON-1683612875 None] Deleting attachment b6607213-b1b9-4287-b50d-f4211bf140af. {{(pid=82819) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 02 12:36:21 devstack sudo[84941]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-525f346d-44c5-4143-9068-2e4d703b2d60" returned: 0 in 0.469s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:21 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:36:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:36:21 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38af4b40-0b51-4bfc-a384-3d9bd3dddcb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-525f346d-44c5-4143-9068-2e4d703b2d60', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:21 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87da9b40-4e09-4b04-8046-13d4c7995d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:21 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Volume volume-525f346d-44c5-4143-9068-2e4d703b2d60 (525f346d-44c5-4143-9068-2e4d703b2d60): created successfully Apr 02 12:36:21 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87da9b40-4e09-4b04-8046-13d4c7995d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:21 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Flow 'volume_create_manager' (0cf8640d-b7f4-449a-9719-ac3b0d8ce043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:36:21 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-9b9495c6-191c-4f53-b9a0-6369a990ec0d tempest-AbsoluteLimitsTests-1013386386 None] Created volume successfully. Apr 02 12:36:22 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-47b0398b-9baa-40a3-b57e-7f55f388825e tempest-AbsoluteLimitsTests-1013386386 None] Acquiring lock "cinder-525f346d-44c5-4143-9068-2e4d703b2d60-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:36:22 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-47b0398b-9baa-40a3-b57e-7f55f388825e tempest-AbsoluteLimitsTests-1013386386 None] Lock "cinder-525f346d-44c5-4143-9068-2e4d703b2d60-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:36:22 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-47b0398b-9baa-40a3-b57e-7f55f388825e tempest-AbsoluteLimitsTests-1013386386 None] Acquiring lock "cinder-quobyte-525f346d-44c5-4143-9068-2e4d703b2d60" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:36:22 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-47b0398b-9baa-40a3-b57e-7f55f388825e tempest-AbsoluteLimitsTests-1013386386 None] Lock "cinder-quobyte-525f346d-44c5-4143-9068-2e4d703b2d60" acquired by "delete_volume" :: waited 0.007s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:36:22 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[35547f51-d8e1-4f87-b2be-a4e5914193bd]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:36:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-47b0398b-9baa-40a3-b57e-7f55f388825e tempest-AbsoluteLimitsTests-1013386386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-525f346d-44c5-4143-9068-2e4d703b2d60 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:22 devstack sudo[84944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-525f346d-44c5-4143-9068-2e4d703b2d60 Apr 02 12:36:22 devstack sudo[84944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:22 devstack sudo[84944]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-47b0398b-9baa-40a3-b57e-7f55f388825e tempest-AbsoluteLimitsTests-1013386386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-525f346d-44c5-4143-9068-2e4d703b2d60" returned: 0 in 0.577s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-47b0398b-9baa-40a3-b57e-7f55f388825e tempest-AbsoluteLimitsTests-1013386386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-525f346d-44c5-4143-9068-2e4d703b2d60 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:23 devstack sudo[84949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-525f346d-44c5-4143-9068-2e4d703b2d60 Apr 02 12:36:23 devstack sudo[84949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:23 devstack sudo[84949]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-47b0398b-9baa-40a3-b57e-7f55f388825e tempest-AbsoluteLimitsTests-1013386386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-525f346d-44c5-4143-9068-2e4d703b2d60" returned: 0 in 0.537s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:23 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-47b0398b-9baa-40a3-b57e-7f55f388825e tempest-AbsoluteLimitsTests-1013386386 None] Lock "cinder-quobyte-525f346d-44c5-4143-9068-2e4d703b2d60" released by "delete_volume" :: held 1.142s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:36:23 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-47b0398b-9baa-40a3-b57e-7f55f388825e tempest-AbsoluteLimitsTests-1013386386 None] Created reservations ['b097ee74-3500-4cce-b9f3-6749b73d2035', 'dca45927-4574-462d-bae4-7f172e6ae832', '10870e4e-c6bd-4fda-9e48-9da90e5e70a5', '4359f12c-50ea-4500-a630-fb492eb71a1c'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:36:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-47b0398b-9baa-40a3-b57e-7f55f388825e tempest-AbsoluteLimitsTests-1013386386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:36:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-47b0398b-9baa-40a3-b57e-7f55f388825e tempest-AbsoluteLimitsTests-1013386386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:36:23 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-47b0398b-9baa-40a3-b57e-7f55f388825e tempest-AbsoluteLimitsTests-1013386386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:36:23 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-47b0398b-9baa-40a3-b57e-7f55f388825e tempest-AbsoluteLimitsTests-1013386386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:36:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-47b0398b-9baa-40a3-b57e-7f55f388825e tempest-AbsoluteLimitsTests-1013386386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:36:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-47b0398b-9baa-40a3-b57e-7f55f388825e tempest-AbsoluteLimitsTests-1013386386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:23 devstack sudo[84952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:36:23 devstack sudo[84952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:24 devstack sudo[84952]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-47b0398b-9baa-40a3-b57e-7f55f388825e tempest-AbsoluteLimitsTests-1013386386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.497s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:24 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-47b0398b-9baa-40a3-b57e-7f55f388825e tempest-AbsoluteLimitsTests-1013386386 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:36:24 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-47b0398b-9baa-40a3-b57e-7f55f388825e tempest-AbsoluteLimitsTests-1013386386 None] Deleted volume successfully. Apr 02 12:36:24 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-47b0398b-9baa-40a3-b57e-7f55f388825e tempest-AbsoluteLimitsTests-1013386386 None] Lock "cinder-525f346d-44c5-4143-9068-2e4d703b2d60-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:36:25 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ead85cfd-5c88-45cf-89ac-5cfd6396349e tempest-DeleteServersTestJSON-1683612875 None] Acquiring lock "cinder-b69b3119-ca1f-45de-9be6-a9b288479df5-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:36:25 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ead85cfd-5c88-45cf-89ac-5cfd6396349e tempest-DeleteServersTestJSON-1683612875 None] Lock "cinder-b69b3119-ca1f-45de-9be6-a9b288479df5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:36:25 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ead85cfd-5c88-45cf-89ac-5cfd6396349e tempest-DeleteServersTestJSON-1683612875 None] Acquiring lock "cinder-quobyte-b69b3119-ca1f-45de-9be6-a9b288479df5" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:36:25 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ead85cfd-5c88-45cf-89ac-5cfd6396349e tempest-DeleteServersTestJSON-1683612875 None] Lock "cinder-quobyte-b69b3119-ca1f-45de-9be6-a9b288479df5" acquired by "delete_volume" :: waited 0.022s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:36:25 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dad5d4a-1b22-401b-a6a4-b0175c22f920]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:36:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ead85cfd-5c88-45cf-89ac-5cfd6396349e tempest-DeleteServersTestJSON-1683612875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b69b3119-ca1f-45de-9be6-a9b288479df5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:26 devstack sudo[84960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b69b3119-ca1f-45de-9be6-a9b288479df5 Apr 02 12:36:26 devstack sudo[84960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:26 devstack sudo[84960]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ead85cfd-5c88-45cf-89ac-5cfd6396349e tempest-DeleteServersTestJSON-1683612875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b69b3119-ca1f-45de-9be6-a9b288479df5" returned: 0 in 0.759s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ead85cfd-5c88-45cf-89ac-5cfd6396349e tempest-DeleteServersTestJSON-1683612875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b69b3119-ca1f-45de-9be6-a9b288479df5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:26 devstack sudo[84978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b69b3119-ca1f-45de-9be6-a9b288479df5 Apr 02 12:36:26 devstack sudo[84978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:27 devstack sudo[84978]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ead85cfd-5c88-45cf-89ac-5cfd6396349e tempest-DeleteServersTestJSON-1683612875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b69b3119-ca1f-45de-9be6-a9b288479df5" returned: 0 in 0.607s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:27 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ead85cfd-5c88-45cf-89ac-5cfd6396349e tempest-DeleteServersTestJSON-1683612875 None] Lock "cinder-quobyte-b69b3119-ca1f-45de-9be6-a9b288479df5" released by "delete_volume" :: held 1.400s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:36:27 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-ead85cfd-5c88-45cf-89ac-5cfd6396349e tempest-DeleteServersTestJSON-1683612875 None] Created reservations ['9fbb5431-1ece-4c0c-8515-eb775aebcc9b', 'ab4653be-5a52-47cd-bcdb-9a200e136f92', 'ca0dce27-e6eb-4d4f-a2e1-423b06ae4799', 'c7bbc281-afbd-4c19-9a63-55bbbba7ae28'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:36:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ead85cfd-5c88-45cf-89ac-5cfd6396349e tempest-DeleteServersTestJSON-1683612875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:36:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ead85cfd-5c88-45cf-89ac-5cfd6396349e tempest-DeleteServersTestJSON-1683612875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:36:27 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ead85cfd-5c88-45cf-89ac-5cfd6396349e tempest-DeleteServersTestJSON-1683612875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:36:27 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ead85cfd-5c88-45cf-89ac-5cfd6396349e tempest-DeleteServersTestJSON-1683612875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:36:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ead85cfd-5c88-45cf-89ac-5cfd6396349e tempest-DeleteServersTestJSON-1683612875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:36:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ead85cfd-5c88-45cf-89ac-5cfd6396349e tempest-DeleteServersTestJSON-1683612875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:27 devstack sudo[84982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:36:27 devstack sudo[84982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:28 devstack sudo[84982]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ead85cfd-5c88-45cf-89ac-5cfd6396349e tempest-DeleteServersTestJSON-1683612875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.532s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:28 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-ead85cfd-5c88-45cf-89ac-5cfd6396349e tempest-DeleteServersTestJSON-1683612875 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:36:28 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-ead85cfd-5c88-45cf-89ac-5cfd6396349e tempest-DeleteServersTestJSON-1683612875 None] Deleted volume successfully. Apr 02 12:36:28 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ead85cfd-5c88-45cf-89ac-5cfd6396349e tempest-DeleteServersTestJSON-1683612875 None] Lock "cinder-b69b3119-ca1f-45de-9be6-a9b288479df5-delete_volume" released by "delete_volume" :: held 2.155s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:36:28 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:36:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Flow 'volume_create_manager' (fc1096f1-da47-43ab-aeef-15375876c964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:36:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05286185-e0eb-473b-a87a-1e35101b61bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05286185-e0eb-473b-a87a-1e35101b61bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1020851847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5638b22e-56fd-4a02-b5e2-8a9b2eb3b9d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731b4e499f614c21b3b7b64ff2ddfcb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:36:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:36:29Z,use_quota=True,user_id='908a6cf3729e40af89bd22ef38eacec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a26664-50f0-4079-8e7a-4182401395c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a26664-50f0-4079-8e7a-4182401395c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699df548-4858-413d-ae1c-bf8b32e6da4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699df548-4858-413d-ae1c-bf8b32e6da4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5638b22e-56fd-4a02-b5e2-8a9b2eb3b9d7', 'volume_name': 'volume-5638b22e-56fd-4a02-b5e2-8a9b2eb3b9d7', 'volume_size': 2}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84492ca8-ca79-4947-a731-352390c3331a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84492ca8-ca79-4947-a731-352390c3331a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b674c644-0a7a-4a3b-9240-edb6365f4845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:28 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Volume 5638b22e-56fd-4a02-b5e2-8a9b2eb3b9d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5638b22e-56fd-4a02-b5e2-8a9b2eb3b9d7', 'volume_size': 2} Apr 02 12:36:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:36:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:36:28 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1020851847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5638b22e-56fd-4a02-b5e2-8a9b2eb3b9d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731b4e499f614c21b3b7b64ff2ddfcb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:36:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:36:29Z,use_quota=True,user_id='908a6cf3729e40af89bd22ef38eacec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:36:28 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Creating volume 5638b22e-56fd-4a02-b5e2-8a9b2eb3b9d7 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:36:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:36:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:36:28 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:36:28 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:36:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:36:28 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:36:28 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:36:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5638b22e-56fd-4a02-b5e2-8a9b2eb3b9d7 2147483648 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:28 devstack sudo[84985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5638b22e-56fd-4a02-b5e2-8a9b2eb3b9d7 2147483648 Apr 02 12:36:28 devstack sudo[84985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:29 devstack sudo[84985]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5638b22e-56fd-4a02-b5e2-8a9b2eb3b9d7 2147483648" returned: 0 in 0.643s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5638b22e-56fd-4a02-b5e2-8a9b2eb3b9d7 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:29 devstack sudo[84990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5638b22e-56fd-4a02-b5e2-8a9b2eb3b9d7 Apr 02 12:36:29 devstack sudo[84990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:30 devstack sudo[84990]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5638b22e-56fd-4a02-b5e2-8a9b2eb3b9d7" returned: 0 in 0.543s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:30 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:36:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:36:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b674c644-0a7a-4a3b-9240-edb6365f4845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5638b22e-56fd-4a02-b5e2-8a9b2eb3b9d7', 'volume_size': 2}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8f38d5-e1eb-4912-8259-07e7676b2008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:30 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Volume volume-5638b22e-56fd-4a02-b5e2-8a9b2eb3b9d7 (5638b22e-56fd-4a02-b5e2-8a9b2eb3b9d7): created successfully Apr 02 12:36:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8f38d5-e1eb-4912-8259-07e7676b2008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Flow 'volume_create_manager' (fc1096f1-da47-43ab-aeef-15375876c964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:36:30 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-687f1367-11f9-4785-bf46-629c8f742c4f tempest-VolumesCloneNegativeTest-319044781 None] Created volume successfully. Apr 02 12:36:31 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e422f0de-b67e-4e7b-ab91-363c7462a331 tempest-VolumesCloneNegativeTest-319044781 None] Acquiring lock "cinder-5638b22e-56fd-4a02-b5e2-8a9b2eb3b9d7-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:36:31 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e422f0de-b67e-4e7b-ab91-363c7462a331 tempest-VolumesCloneNegativeTest-319044781 None] Lock "cinder-5638b22e-56fd-4a02-b5e2-8a9b2eb3b9d7-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:36:31 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e422f0de-b67e-4e7b-ab91-363c7462a331 tempest-VolumesCloneNegativeTest-319044781 None] Acquiring lock "cinder-quobyte-5638b22e-56fd-4a02-b5e2-8a9b2eb3b9d7" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:36:31 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e422f0de-b67e-4e7b-ab91-363c7462a331 tempest-VolumesCloneNegativeTest-319044781 None] Lock "cinder-quobyte-5638b22e-56fd-4a02-b5e2-8a9b2eb3b9d7" acquired by "delete_volume" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:36:31 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccd1522-5a4a-4188-9259-7ab2e5a4e0e0]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:36:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e422f0de-b67e-4e7b-ab91-363c7462a331 tempest-VolumesCloneNegativeTest-319044781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5638b22e-56fd-4a02-b5e2-8a9b2eb3b9d7 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:31 devstack sudo[84994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5638b22e-56fd-4a02-b5e2-8a9b2eb3b9d7 Apr 02 12:36:31 devstack sudo[84994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:31 devstack sudo[84994]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e422f0de-b67e-4e7b-ab91-363c7462a331 tempest-VolumesCloneNegativeTest-319044781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5638b22e-56fd-4a02-b5e2-8a9b2eb3b9d7" returned: 0 in 0.597s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e422f0de-b67e-4e7b-ab91-363c7462a331 tempest-VolumesCloneNegativeTest-319044781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5638b22e-56fd-4a02-b5e2-8a9b2eb3b9d7 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:31 devstack sudo[85000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5638b22e-56fd-4a02-b5e2-8a9b2eb3b9d7 Apr 02 12:36:31 devstack sudo[85000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:32 devstack sudo[85000]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e422f0de-b67e-4e7b-ab91-363c7462a331 tempest-VolumesCloneNegativeTest-319044781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5638b22e-56fd-4a02-b5e2-8a9b2eb3b9d7" returned: 0 in 0.763s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:32 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e422f0de-b67e-4e7b-ab91-363c7462a331 tempest-VolumesCloneNegativeTest-319044781 None] Lock "cinder-quobyte-5638b22e-56fd-4a02-b5e2-8a9b2eb3b9d7" released by "delete_volume" :: held 1.397s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:36:32 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-e422f0de-b67e-4e7b-ab91-363c7462a331 tempest-VolumesCloneNegativeTest-319044781 None] Created reservations ['d3b6d9ad-fe8f-450c-a18a-77071b75e83a', 'ee2ef4fa-1903-4655-9fb6-ad0a4e44ae0a', '3ecff0da-8352-4f3b-8672-251627492a2e', '0d9cf80d-6d88-4447-bdd9-4bbfb6dc7215'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:36:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e422f0de-b67e-4e7b-ab91-363c7462a331 tempest-VolumesCloneNegativeTest-319044781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:36:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e422f0de-b67e-4e7b-ab91-363c7462a331 tempest-VolumesCloneNegativeTest-319044781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:36:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e422f0de-b67e-4e7b-ab91-363c7462a331 tempest-VolumesCloneNegativeTest-319044781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:36:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e422f0de-b67e-4e7b-ab91-363c7462a331 tempest-VolumesCloneNegativeTest-319044781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:36:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e422f0de-b67e-4e7b-ab91-363c7462a331 tempest-VolumesCloneNegativeTest-319044781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:36:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e422f0de-b67e-4e7b-ab91-363c7462a331 tempest-VolumesCloneNegativeTest-319044781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:32 devstack sudo[85003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:36:32 devstack sudo[85003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:33 devstack sudo[85003]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e422f0de-b67e-4e7b-ab91-363c7462a331 tempest-VolumesCloneNegativeTest-319044781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.614s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:33 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-e422f0de-b67e-4e7b-ab91-363c7462a331 tempest-VolumesCloneNegativeTest-319044781 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:36:33 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-e422f0de-b67e-4e7b-ab91-363c7462a331 tempest-VolumesCloneNegativeTest-319044781 None] Deleted volume successfully. Apr 02 12:36:33 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e422f0de-b67e-4e7b-ab91-363c7462a331 tempest-VolumesCloneNegativeTest-319044781 None] Lock "cinder-5638b22e-56fd-4a02-b5e2-8a9b2eb3b9d7-delete_volume" released by "delete_volume" :: held 2.191s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:36:42 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:UPDATE=54,cinder:SELECT=49,cinder:INSERT=22,cinder:DELETE=4 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:36:43 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:SELECT=56,cinder:UPDATE=63,cinder:INSERT=16,cinder:DELETE=5 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:36:53 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:36:53 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Flow 'volume_create_manager' (05080529-9b76-4535-a25d-4ed70713ddc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:36:53 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ca42a2-cb8f-41d0-9acc-beddcb96bc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:53 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ca42a2-cb8f-41d0-9acc-beddcb96bc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1063680600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1de41833-a040-4487-b30e-a12caa01c6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c9e78b8b5140a49cfc4984a3d0f7e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:36:54Z,use_quota=True,user_id='beb5e9a518c14980ade9a58efb599d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:53 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc9cefb-890c-406a-856d-651f144cc4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:53 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc9cefb-890c-406a-856d-651f144cc4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:53 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ebb4e4-6a25-410c-b2a8-dd91faa3fda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:53 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ebb4e4-6a25-410c-b2a8-dd91faa3fda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1de41833-a040-4487-b30e-a12caa01c6d4', 'volume_name': 'volume-1de41833-a040-4487-b30e-a12caa01c6d4', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:53 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eecdc6a-583d-4215-98a9-c3acbf2b729a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:53 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eecdc6a-583d-4215-98a9-c3acbf2b729a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:53 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c745156-efa0-461d-9812-ec604075fde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:53 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Volume 1de41833-a040-4487-b30e-a12caa01c6d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1de41833-a040-4487-b30e-a12caa01c6d4', 'volume_size': 1} Apr 02 12:36:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:36:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:36:53 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1063680600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1de41833-a040-4487-b30e-a12caa01c6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c9e78b8b5140a49cfc4984a3d0f7e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:36:54Z,use_quota=True,user_id='beb5e9a518c14980ade9a58efb599d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:36:53 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Creating volume 1de41833-a040-4487-b30e-a12caa01c6d4 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:36:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:36:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:36:53 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:36:53 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:36:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:36:53 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:36:53 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:36:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:53 devstack sudo[85105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4 1073741824 Apr 02 12:36:53 devstack sudo[85105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:54 devstack sudo[85105]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4 1073741824" returned: 0 in 0.840s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:54 devstack sudo[85142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4 Apr 02 12:36:54 devstack sudo[85142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:55 devstack sudo[85142]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4" returned: 0 in 0.561s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:55 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:36:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:36:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c745156-efa0-461d-9812-ec604075fde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1de41833-a040-4487-b30e-a12caa01c6d4', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7614b18a-a0ce-466a-a6c9-180a5cd1e17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:36:55 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Volume volume-1de41833-a040-4487-b30e-a12caa01c6d4 (1de41833-a040-4487-b30e-a12caa01c6d4): created successfully Apr 02 12:36:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7614b18a-a0ce-466a-a6c9-180a5cd1e17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:36:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Flow 'volume_create_manager' (05080529-9b76-4535-a25d-4ed70713ddc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:36:55 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-0fc59237-a418-4d68-8820-1a65bb01e442 tempest-VolumesSnapshotTestJSON-793399911 None] Created volume successfully. Apr 02 12:36:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2515f1b1-988c-4ef7-9267-adbba26b2f87 tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:36:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2515f1b1-988c-4ef7-9267-adbba26b2f87 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:36:56 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-2515f1b1-988c-4ef7-9267-adbba26b2f87 tempest-VolumesSnapshotTestJSON-793399911 None] Creating offline snapshot bcbfd94c-071d-4b16-9498-a8d710bdc534 of volume 1de41833-a040-4487-b30e-a12caa01c6d4 {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:36:56 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad317d2-69d2-4161-a63a-1760e0eb7898]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:36:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2515f1b1-988c-4ef7-9267-adbba26b2f87 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:56 devstack sudo[85149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4 Apr 02 12:36:56 devstack sudo[85149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:56 devstack sudo[85149]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2515f1b1-988c-4ef7-9267-adbba26b2f87 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4" returned: 0 in 0.589s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2515f1b1-988c-4ef7-9267-adbba26b2f87 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4.bcbfd94c-071d-4b16-9498-a8d710bdc534 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:56 devstack sudo[85154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4.bcbfd94c-071d-4b16-9498-a8d710bdc534 1G Apr 02 12:36:56 devstack sudo[85154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:57 devstack sudo[85154]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2515f1b1-988c-4ef7-9267-adbba26b2f87 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4.bcbfd94c-071d-4b16-9498-a8d710bdc534 1G" returned: 0 in 0.537s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2515f1b1-988c-4ef7-9267-adbba26b2f87 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1de41833-a040-4487-b30e-a12caa01c6d4 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4.bcbfd94c-071d-4b16-9498-a8d710bdc534 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:57 devstack sudo[85159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1de41833-a040-4487-b30e-a12caa01c6d4 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4.bcbfd94c-071d-4b16-9498-a8d710bdc534 Apr 02 12:36:57 devstack sudo[85159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:57 devstack sudo[85159]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2515f1b1-988c-4ef7-9267-adbba26b2f87 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1de41833-a040-4487-b30e-a12caa01c6d4 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4.bcbfd94c-071d-4b16-9498-a8d710bdc534" returned: 0 in 0.636s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:57 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-2515f1b1-988c-4ef7-9267-adbba26b2f87 tempest-VolumesSnapshotTestJSON-793399911 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4.bcbfd94c-071d-4b16-9498-a8d710bdc534 is being set with open permissions: ugo+rw Apr 02 12:36:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2515f1b1-988c-4ef7-9267-adbba26b2f87 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4.bcbfd94c-071d-4b16-9498-a8d710bdc534 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:57 devstack sudo[85165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4.bcbfd94c-071d-4b16-9498-a8d710bdc534 Apr 02 12:36:57 devstack sudo[85165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:58 devstack sudo[85165]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2515f1b1-988c-4ef7-9267-adbba26b2f87 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4.bcbfd94c-071d-4b16-9498-a8d710bdc534" returned: 0 in 0.464s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2515f1b1-988c-4ef7-9267-adbba26b2f87 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:58 devstack sudo[85174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4.info Apr 02 12:36:58 devstack sudo[85174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:58 devstack sudo[85174]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2515f1b1-988c-4ef7-9267-adbba26b2f87 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4.info" returned: 0 in 0.651s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:58 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-2515f1b1-988c-4ef7-9267-adbba26b2f87 tempest-VolumesSnapshotTestJSON-793399911 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4.info is being set with open permissions: ugo+rw Apr 02 12:36:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2515f1b1-988c-4ef7-9267-adbba26b2f87 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:36:58 devstack sudo[85190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4.info Apr 02 12:36:58 devstack sudo[85190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:36:59 devstack sudo[85190]: pam_unix(sudo:session): session closed for user root Apr 02 12:36:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2515f1b1-988c-4ef7-9267-adbba26b2f87 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4.info" returned: 0 in 0.441s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:36:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2515f1b1-988c-4ef7-9267-adbba26b2f87 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.396s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:36:59 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-2515f1b1-988c-4ef7-9267-adbba26b2f87 tempest-VolumesSnapshotTestJSON-793399911 None] Create snapshot completed successfully Apr 02 12:37:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-026ac55c-0b6f-4694-ac0e-f67c971d888b tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "cinder-bcbfd94c-071d-4b16-9498-a8d710bdc534-delete_snapshot" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-026ac55c-0b6f-4694-ac0e-f67c971d888b tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-bcbfd94c-071d-4b16-9498-a8d710bdc534-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-026ac55c-0b6f-4694-ac0e-f67c971d888b tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "cinder-quobyte-1de41833-a040-4487-b30e-a12caa01c6d4" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-026ac55c-0b6f-4694-ac0e-f67c971d888b tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-1de41833-a040-4487-b30e-a12caa01c6d4" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-026ac55c-0b6f-4694-ac0e-f67c971d888b tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "cinder-quobyte-bcbfd94c-071d-4b16-9498-a8d710bdc534" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-026ac55c-0b6f-4694-ac0e-f67c971d888b tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-bcbfd94c-071d-4b16-9498-a8d710bdc534" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:00 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-026ac55c-0b6f-4694-ac0e-f67c971d888b tempest-VolumesSnapshotTestJSON-793399911 None] Deleting offline snapshot bcbfd94c-071d-4b16-9498-a8d710bdc534 of volume 1de41833-a040-4487-b30e-a12caa01c6d4 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:37:00 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-026ac55c-0b6f-4694-ac0e-f67c971d888b tempest-VolumesSnapshotTestJSON-793399911 None] snapshot_file for this snap is: volume-1de41833-a040-4487-b30e-a12caa01c6d4.bcbfd94c-071d-4b16-9498-a8d710bdc534 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:37:00 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[704f67bd-8934-49e8-83d8-3f3599766fe8]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:37:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-026ac55c-0b6f-4694-ac0e-f67c971d888b tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4.bcbfd94c-071d-4b16-9498-a8d710bdc534 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:00 devstack sudo[85211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4.bcbfd94c-071d-4b16-9498-a8d710bdc534 Apr 02 12:37:00 devstack sudo[85211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:01 devstack sudo[85211]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-026ac55c-0b6f-4694-ac0e-f67c971d888b tempest-VolumesSnapshotTestJSON-793399911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4.bcbfd94c-071d-4b16-9498-a8d710bdc534" returned: 0 in 0.600s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:01 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-026ac55c-0b6f-4694-ac0e-f67c971d888b tempest-VolumesSnapshotTestJSON-793399911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1de41833-a040-4487-b30e-a12caa01c6d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:37:01 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaedb1f7-b423-411b-b6aa-3c68be4b5e22]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:37:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-026ac55c-0b6f-4694-ac0e-f67c971d888b tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:01 devstack sudo[85216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4 Apr 02 12:37:01 devstack sudo[85216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:02 devstack sudo[85216]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-026ac55c-0b6f-4694-ac0e-f67c971d888b tempest-VolumesSnapshotTestJSON-793399911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4" returned: 0 in 1.035s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-026ac55c-0b6f-4694-ac0e-f67c971d888b tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4.bcbfd94c-071d-4b16-9498-a8d710bdc534 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:02 devstack sudo[85221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4.bcbfd94c-071d-4b16-9498-a8d710bdc534 Apr 02 12:37:02 devstack sudo[85221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:03 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:37:03 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Flow 'volume_create_manager' (e1de89e0-053b-4ec2-8336-097e1a53927b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:37:03 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c63ede12-c7df-4a00-995e-b659eb4be9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:03 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c63ede12-c7df-4a00-995e-b659eb4be9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:37:03Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=911394f4-ca98-42cc-b340-e530f74ec96d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f0ed1bf7fd54798a72424291db25f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:37:03Z,use_quota=True,user_id='1afcac2ffd6e486cb8119f1fbe58eb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:03 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a9c2399-a860-4a64-945b-cf55d8a1666a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:03 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a9c2399-a860-4a64-945b-cf55d8a1666a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:03 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4182d94f-51ac-4e87-84d0-ad07b2974a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:03 devstack cinder-volume[82819]: DEBUG cinder.image.glance [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Creating Keystone auth plugin from conf {{(pid=82819) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 02 12:37:03 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4182d94f-51ac-4e87-84d0-ad07b2974a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '911394f4-ca98-42cc-b340-e530f74ec96d', 'volume_name': 'volume-911394f4-ca98-42cc-b340-e530f74ec96d', 'volume_size': 1, 'image_id': '361107cd-f0bc-4798-a524-aa6f2b337172', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/361107cd-f0bc-4798-a524-aa6f2b337172', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd668ace29fed46e98c54f346600c750f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '361107cd-f0bc-4798-a524-aa6f2b337172', 'created_at': datetime.datetime(2026, 4, 2, 10, 29, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 10, 29, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/361107cd-f0bc-4798-a524-aa6f2b337172/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:03 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (155cafeb-3f3d-4411-9ab6-36db9ab74544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:03 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (155cafeb-3f3d-4411-9ab6-36db9ab74544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:03 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41653014-80c5-4593-adfa-8a45350fa250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:03 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Volume 911394f4-ca98-42cc-b340-e530f74ec96d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-911394f4-ca98-42cc-b340-e530f74ec96d', 'volume_size': 1, 'image_id': '361107cd-f0bc-4798-a524-aa6f2b337172', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/361107cd-f0bc-4798-a524-aa6f2b337172', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd668ace29fed46e98c54f346600c750f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '361107cd-f0bc-4798-a524-aa6f2b337172', 'created_at': datetime.datetime(2026, 4, 2, 10, 29, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 10, 29, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/361107cd-f0bc-4798-a524-aa6f2b337172/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 02 12:37:03 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Trying to clone 911394f4-ca98-42cc-b340-e530f74ec96d from image 361107cd-f0bc-4798-a524-aa6f2b337172 at location (None, [{'url': 'file:///opt/stack/data/glance/images/361107cd-f0bc-4798-a524-aa6f2b337172', 'metadata': {}}]). {{(pid=82819) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 02 12:37:03 devstack sudo[85221]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-026ac55c-0b6f-4694-ac0e-f67c971d888b tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4.bcbfd94c-071d-4b16-9498-a8d710bdc534" returned: 0 in 1.510s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-026ac55c-0b6f-4694-ac0e-f67c971d888b tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4.bcbfd94c-071d-4b16-9498-a8d710bdc534 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:03 devstack sudo[85244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4.bcbfd94c-071d-4b16-9498-a8d710bdc534 Apr 02 12:37:03 devstack sudo[85244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:04 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_qfvo1kl8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82819) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 02 12:37:04 devstack cinder-volume[82819]: INFO cinder.image.image_utils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Image download 20.69 MB at 20.69 MB/s Apr 02 12:37:04 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[654d4685-7c92-462f-a536-668905af9ffd]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:37:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_qfvo1kl8devstack@QuobyteHD {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:04 devstack sudo[85247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_qfvo1kl8devstack@QuobyteHD Apr 02 12:37:04 devstack sudo[85247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:04 devstack sudo[85244]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-026ac55c-0b6f-4694-ac0e-f67c971d888b tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4.bcbfd94c-071d-4b16-9498-a8d710bdc534" returned: 0 in 0.688s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:04 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-026ac55c-0b6f-4694-ac0e-f67c971d888b tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-bcbfd94c-071d-4b16-9498-a8d710bdc534" released by "_delete_snapshot" :: held 3.923s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:04 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-026ac55c-0b6f-4694-ac0e-f67c971d888b tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-1de41833-a040-4487-b30e-a12caa01c6d4" released by "delete_snapshot" :: held 3.941s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:04 devstack cinder-volume[82819]: WARNING cinder.quota [None req-026ac55c-0b6f-4694-ac0e-f67c971d888b tempest-VolumesSnapshotTestJSON-793399911 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 02 12:37:04 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-026ac55c-0b6f-4694-ac0e-f67c971d888b tempest-VolumesSnapshotTestJSON-793399911 None] Created reservations ['ee2292e5-b5cc-453d-a752-a48bc15998f1', '5adde8aa-7211-4439-95b1-913f009cf0c6', '6438e5ff-6da0-45e0-9aa3-fefc6f272f86', '9874dd87-a071-43f8-9a23-e67875ad0da6'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:37:04 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-026ac55c-0b6f-4694-ac0e-f67c971d888b tempest-VolumesSnapshotTestJSON-793399911 None] Delete snapshot completed successfully. Apr 02 12:37:04 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-026ac55c-0b6f-4694-ac0e-f67c971d888b tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-bcbfd94c-071d-4b16-9498-a8d710bdc534-delete_snapshot" released by "delete_snapshot" :: held 4.274s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:05 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:37:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Flow 'volume_create_manager' (f312be83-4b87-4bda-99b3-a75b005726e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:37:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21477de7-cacf-4435-b5b1-b1f66787477b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21477de7-cacf-4435-b5b1-b1f66787477b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1956355370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05197a10-d090-4d5e-992a-90cee9466b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c9e78b8b5140a49cfc4984a3d0f7e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:37:06Z,use_quota=True,user_id='beb5e9a518c14980ade9a58efb599d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a89131f4-5b08-4a0f-aa6e-14c23d425ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a89131f4-5b08-4a0f-aa6e-14c23d425ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a85470b3-f60f-495b-9bc7-bae46fde2c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a85470b3-f60f-495b-9bc7-bae46fde2c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05197a10-d090-4d5e-992a-90cee9466b4e', 'volume_name': 'volume-05197a10-d090-4d5e-992a-90cee9466b4e', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223af6fd-38eb-46b2-98f8-3ae3b55f7bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223af6fd-38eb-46b2-98f8-3ae3b55f7bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5210d5-13a4-4126-aa34-13f8dd125a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:05 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Volume 05197a10-d090-4d5e-992a-90cee9466b4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05197a10-d090-4d5e-992a-90cee9466b4e', 'volume_size': 1} Apr 02 12:37:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:05 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1956355370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05197a10-d090-4d5e-992a-90cee9466b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c9e78b8b5140a49cfc4984a3d0f7e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:37:06Z,use_quota=True,user_id='beb5e9a518c14980ade9a58efb599d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:37:05 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Creating volume 05197a10-d090-4d5e-992a-90cee9466b4e {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:37:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:05 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:37:05 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:37:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:05 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:37:05 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:37:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:05 devstack sudo[85294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e 1073741824 Apr 02 12:37:05 devstack sudo[85294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:06 devstack sudo[85247]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_qfvo1kl8devstack@QuobyteHD" returned: 0 in 1.991s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:06 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Temporary image 361107cd-f0bc-4798-a524-aa6f2b337172 is fetched for user 1afcac2ffd6e486cb8119f1fbe58eb2b. {{(pid=82819) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 02 12:37:06 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[8168c762-40bc-4edd-b591-75676b8da046]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:37:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_qfvo1kl8devstack@QuobyteHD {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:06 devstack sudo[85298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_qfvo1kl8devstack@QuobyteHD Apr 02 12:37:06 devstack sudo[85298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:07 devstack sudo[85294]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e 1073741824" returned: 0 in 1.159s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:07 devstack sudo[85309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e Apr 02 12:37:07 devstack sudo[85309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:07 devstack sudo[85298]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_qfvo1kl8devstack@QuobyteHD" returned: 0 in 0.883s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:07 devstack sudo[85309]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e" returned: 0 in 0.546s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:07 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:37:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.486s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:07 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:37:03Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=911394f4-ca98-42cc-b340-e530f74ec96d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f0ed1bf7fd54798a72424291db25f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:37:03Z,use_quota=True,user_id='1afcac2ffd6e486cb8119f1fbe58eb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:37:07 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Creating volume 911394f4-ca98-42cc-b340-e530f74ec96d {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:37:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:07 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:37:07 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:37:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:07 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:37:07 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:37:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:07 devstack sudo[85315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d 1073741824 Apr 02 12:37:07 devstack sudo[85315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:07 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5210d5-13a4-4126-aa34-13f8dd125a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05197a10-d090-4d5e-992a-90cee9466b4e', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:07 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ab236a5-7097-4d14-b436-8c4415256a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:07 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Volume volume-05197a10-d090-4d5e-992a-90cee9466b4e (05197a10-d090-4d5e-992a-90cee9466b4e): created successfully Apr 02 12:37:07 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ab236a5-7097-4d14-b436-8c4415256a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:07 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Flow 'volume_create_manager' (f312be83-4b87-4bda-99b3-a75b005726e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:37:07 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-e79053ca-7ec2-4d8b-bf27-22911749ea58 tempest-VolumesSnapshotTestJSON-793399911 None] Created volume successfully. Apr 02 12:37:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9941311e-b681-4c2d-b3d4-a835ee54564d tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:08 devstack sudo[85315]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d 1073741824" returned: 0 in 1.092s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:08 devstack sudo[85322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d Apr 02 12:37:08 devstack sudo[85322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:09 devstack sudo[85322]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d" returned: 0 in 0.469s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:09 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:37:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9941311e-b681-4c2d-b3d4-a835ee54564d tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.076s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:09 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-9941311e-b681-4c2d-b3d4-a835ee54564d tempest-VolumesSnapshotTestJSON-793399911 None] Creating offline snapshot 067e844b-dddb-4fc3-a54e-00564ee0de36 of volume 05197a10-d090-4d5e-992a-90cee9466b4e {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:37:09 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[68abdec6-5ec0-48c1-b85f-0b859e4da3c2]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:37:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9941311e-b681-4c2d-b3d4-a835ee54564d tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:09 devstack cinder-volume[82819]: DEBUG cinder.volume.volume_utils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Attempting download of 361107cd-f0bc-4798-a524-aa6f2b337172 ((None, [{'url': 'file:///opt/stack/data/glance/images/361107cd-f0bc-4798-a524-aa6f2b337172', 'metadata': {}}])) to volume 911394f4-ca98-42cc-b340-e530f74ec96d. {{(pid=82819) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 02 12:37:09 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[99589558-a405-4d2a-abd8-9502bba4d2cf]: (4, 'raw') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:37:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_361107cd-f0bc-4798-a524-aa6f2b337172_pz5nponx {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:09 devstack sudo[85325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e Apr 02 12:37:09 devstack sudo[85325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:09 devstack sudo[85326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_361107cd-f0bc-4798-a524-aa6f2b337172_pz5nponx Apr 02 12:37:09 devstack sudo[85326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:10 devstack sudo[85326]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_361107cd-f0bc-4798-a524-aa6f2b337172_pz5nponx" returned: 0 in 0.883s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_361107cd-f0bc-4798-a524-aa6f2b337172_pz5nponx {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:10 devstack sudo[85334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_361107cd-f0bc-4798-a524-aa6f2b337172_pz5nponx Apr 02 12:37:10 devstack sudo[85334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:10 devstack sudo[85325]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9941311e-b681-4c2d-b3d4-a835ee54564d tempest-VolumesSnapshotTestJSON-793399911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e" returned: 0 in 1.142s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9941311e-b681-4c2d-b3d4-a835ee54564d tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.067e844b-dddb-4fc3-a54e-00564ee0de36 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:10 devstack sudo[85339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.067e844b-dddb-4fc3-a54e-00564ee0de36 1G Apr 02 12:37:10 devstack sudo[85339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:11 devstack sudo[85334]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_361107cd-f0bc-4798-a524-aa6f2b337172_pz5nponx" returned: 1 in 1.164s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_361107cd-f0bc-4798-a524-aa6f2b337172_pz5nponx' failed. Not Retrying. {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 12:37:11 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e47cfd-4ec8-420c-aa65-b24ca46e01b3]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:37:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_qfvo1kl8devstack@QuobyteHD {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:11 devstack sudo[85350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_qfvo1kl8devstack@QuobyteHD Apr 02 12:37:11 devstack sudo[85350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:12 devstack sudo[85339]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9941311e-b681-4c2d-b3d4-a835ee54564d tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.067e844b-dddb-4fc3-a54e-00564ee0de36 1G" returned: 0 in 1.630s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9941311e-b681-4c2d-b3d4-a835ee54564d tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05197a10-d090-4d5e-992a-90cee9466b4e -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.067e844b-dddb-4fc3-a54e-00564ee0de36 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:12 devstack sudo[85378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05197a10-d090-4d5e-992a-90cee9466b4e -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.067e844b-dddb-4fc3-a54e-00564ee0de36 Apr 02 12:37:12 devstack sudo[85378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:12 devstack sudo[85350]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_qfvo1kl8devstack@QuobyteHD" returned: 0 in 0.802s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:12 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] 361107cd-f0bc-4798-a524-aa6f2b337172 was qcow2, converting to raw {{(pid=82819) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 02 12:37:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_qfvo1kl8devstack@QuobyteHD /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:12 devstack sudo[85383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_qfvo1kl8devstack@QuobyteHD /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d Apr 02 12:37:12 devstack sudo[85383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:13 devstack cinder-volume[82819]: DEBUG oslo_service.periodic_task [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82819) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 12:37:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:37:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:37:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:13 devstack sudo[85393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:37:13 devstack sudo[85393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:13 devstack sudo[85378]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9941311e-b681-4c2d-b3d4-a835ee54564d tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05197a10-d090-4d5e-992a-90cee9466b4e -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.067e844b-dddb-4fc3-a54e-00564ee0de36" returned: 0 in 1.470s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:13 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-9941311e-b681-4c2d-b3d4-a835ee54564d tempest-VolumesSnapshotTestJSON-793399911 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.067e844b-dddb-4fc3-a54e-00564ee0de36 is being set with open permissions: ugo+rw Apr 02 12:37:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9941311e-b681-4c2d-b3d4-a835ee54564d tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.067e844b-dddb-4fc3-a54e-00564ee0de36 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:13 devstack sudo[85408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.067e844b-dddb-4fc3-a54e-00564ee0de36 Apr 02 12:37:13 devstack sudo[85408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:13 devstack sudo[85393]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.811s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:13 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:37:14 devstack sudo[85408]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9941311e-b681-4c2d-b3d4-a835ee54564d tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.067e844b-dddb-4fc3-a54e-00564ee0de36" returned: 0 in 0.658s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9941311e-b681-4c2d-b3d4-a835ee54564d tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:14 devstack sudo[85412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.info Apr 02 12:37:14 devstack sudo[85412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:14 devstack sudo[85383]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_qfvo1kl8devstack@QuobyteHD /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d" returned: 0 in 2.493s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:14 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_qfvo1kl8devstack@QuobyteHD, size 112.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d {{(pid=82819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 12:37:14 devstack cinder-volume[82819]: INFO cinder.image.image_utils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Converted 112.00 MB image at 44.90 MB/s Apr 02 12:37:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:14 devstack sudo[85414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d 1G Apr 02 12:37:14 devstack sudo[85414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:14 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:37:15 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Flow 'volume_create_manager' (c8ae1801-59ba-4990-bfb2-32adbea41fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:37:15 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd75c22-2df5-4da6-9981-c5dd953b77a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:15 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd75c22-2df5-4da6-9981-c5dd953b77a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1842738056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=470ac989-7582-41cb-b48f-fa45f4d7b9d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7f355ba2fa49898dd2462006b4d097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:37:15Z,use_quota=True,user_id='4f8a8be9251548f88774d3bc62622c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:15 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cbbc963-e6eb-4685-8483-e05b1c2b7f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:15 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cbbc963-e6eb-4685-8483-e05b1c2b7f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:15 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e65cf9-c60f-4951-a5e8-b8f92b1a9424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:15 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e65cf9-c60f-4951-a5e8-b8f92b1a9424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '470ac989-7582-41cb-b48f-fa45f4d7b9d6', 'volume_name': 'volume-470ac989-7582-41cb-b48f-fa45f4d7b9d6', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:15 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb4fe85-30c8-4bcf-9cae-161c08e08d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:15 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb4fe85-30c8-4bcf-9cae-161c08e08d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:15 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5a4738-cec7-4ad0-93a4-cde236960182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:15 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Volume 470ac989-7582-41cb-b48f-fa45f4d7b9d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-470ac989-7582-41cb-b48f-fa45f4d7b9d6', 'volume_size': 1} Apr 02 12:37:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:15 devstack sudo[85412]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9941311e-b681-4c2d-b3d4-a835ee54564d tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.info" returned: 0 in 0.949s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:15 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-9941311e-b681-4c2d-b3d4-a835ee54564d tempest-VolumesSnapshotTestJSON-793399911 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.info is being set with open permissions: ugo+rw Apr 02 12:37:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9941311e-b681-4c2d-b3d4-a835ee54564d tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:15 devstack sudo[85418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.info Apr 02 12:37:15 devstack sudo[85418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:15 devstack sudo[85414]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d 1G" returned: 0 in 0.785s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:15 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fd42bd-fc39-4662-91dc-03d7d4459a0f]: (4, 'raw') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:37:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:15 devstack sudo[85423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d Apr 02 12:37:15 devstack sudo[85423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:15 devstack sudo[85418]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9941311e-b681-4c2d-b3d4-a835ee54564d tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.info" returned: 0 in 0.548s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9941311e-b681-4c2d-b3d4-a835ee54564d tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.505s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.605s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:15 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1842738056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=470ac989-7582-41cb-b48f-fa45f4d7b9d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7f355ba2fa49898dd2462006b4d097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:37:15Z,use_quota=True,user_id='4f8a8be9251548f88774d3bc62622c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:37:15 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Creating volume 470ac989-7582-41cb-b48f-fa45f4d7b9d6 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:37:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:15 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:37:15 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:37:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:15 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:37:15 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:37:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-470ac989-7582-41cb-b48f-fa45f4d7b9d6 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:15 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-9941311e-b681-4c2d-b3d4-a835ee54564d tempest-VolumesSnapshotTestJSON-793399911 None] Create snapshot completed successfully Apr 02 12:37:15 devstack sudo[85426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-470ac989-7582-41cb-b48f-fa45f4d7b9d6 1073741824 Apr 02 12:37:15 devstack sudo[85426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:16 devstack sudo[85423]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d" returned: 0 in 0.875s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:16 devstack sudo[85433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d Apr 02 12:37:16 devstack sudo[85433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:16 devstack sudo[85426]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-470ac989-7582-41cb-b48f-fa45f4d7b9d6 1073741824" returned: 0 in 1.120s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-470ac989-7582-41cb-b48f-fa45f4d7b9d6 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:17 devstack sudo[85435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-470ac989-7582-41cb-b48f-fa45f4d7b9d6 Apr 02 12:37:17 devstack sudo[85435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:17 devstack sudo[85433]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d" returned: 1 in 0.978s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d' failed. Not Retrying. {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG cinder.volume.volume_utils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Downloaded image 361107cd-f0bc-4798-a524-aa6f2b337172 ((None, [{'url': 'file:///opt/stack/data/glance/images/361107cd-f0bc-4798-a524-aa6f2b337172', 'metadata': {}}])) to volume 911394f4-ca98-42cc-b340-e530f74ec96d successfully. {{(pid=82819) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Temporary image 361107cd-f0bc-4798-a524-aa6f2b337172 for user 1afcac2ffd6e486cb8119f1fbe58eb2b is deleted. {{(pid=82819) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG cinder.volume.volume_utils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Marking volume 911394f4-ca98-42cc-b340-e530f74ec96d as bootable. {{(pid=82819) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Copying metadata from image 361107cd-f0bc-4798-a524-aa6f2b337172 to 911394f4-ca98-42cc-b340-e530f74ec96d. {{(pid=82819) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Creating volume glance metadata for volume 911394f4-ca98-42cc-b340-e530f74ec96d backed by image 361107cd-f0bc-4798-a524-aa6f2b337172 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '361107cd-f0bc-4798-a524-aa6f2b337172', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82819) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41653014-80c5-4593-adfa-8a45350fa250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-911394f4-ca98-42cc-b340-e530f74ec96d', 'volume_size': 1, 'image_id': '361107cd-f0bc-4798-a524-aa6f2b337172', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/361107cd-f0bc-4798-a524-aa6f2b337172', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd668ace29fed46e98c54f346600c750f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '361107cd-f0bc-4798-a524-aa6f2b337172', 'created_at': datetime.datetime(2026, 4, 2, 10, 29, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 10, 29, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/361107cd-f0bc-4798-a524-aa6f2b337172/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8472038b-12df-490b-97f9-d1a19b103d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Flow 'volume_create_manager' (be7cae60-6265-4ce9-8847-351f0d59647d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cafd1750-b74f-4c76-874d-206ecc867b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cafd1750-b74f-4c76-874d-206ecc867b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-644331879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f95b7f6a-8796-4473-aa04-81afee3bf964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c9e78b8b5140a49cfc4984a3d0f7e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:37:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=067e844b-dddb-4fc3-a54e-00564ee0de36,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:37:18Z,use_quota=True,user_id='beb5e9a518c14980ade9a58efb599d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:17 devstack sudo[85435]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830d8538-adb8-4af8-87d3-21c3e675baf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830d8538-adb8-4af8-87d3-21c3e675baf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a816f7-e02e-4c7f-aefb-107713b3d1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a816f7-e02e-4c7f-aefb-107713b3d1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f95b7f6a-8796-4473-aa04-81afee3bf964', 'volume_name': 'volume-f95b7f6a-8796-4473-aa04-81afee3bf964', 'volume_size': 2, 'snapshot_id': '067e844b-dddb-4fc3-a54e-00564ee0de36'}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (143a753e-2d02-4b06-bce9-ff98e6867977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (143a753e-2d02-4b06-bce9-ff98e6867977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a976a0ae-d854-4b15-bc10-e9c2a478cc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:17 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Volume f95b7f6a-8796-4473-aa04-81afee3bf964: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f95b7f6a-8796-4473-aa04-81afee3bf964', 'volume_size': 2, 'snapshot_id': '067e844b-dddb-4fc3-a54e-00564ee0de36'} Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-470ac989-7582-41cb-b48f-fa45f4d7b9d6" returned: 0 in 1.030s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] <== create_volume: return (2203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.207s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.006s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "cinder-quobyte-067e844b-dddb-4fc3-a54e-00564ee0de36-f95b7f6a-8796-4473-aa04-81afee3bf964" by "_create_volume_from_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:17 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Volume volume-911394f4-ca98-42cc-b340-e530f74ec96d (911394f4-ca98-42cc-b340-e530f74ec96d): created successfully Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8472038b-12df-490b-97f9-d1a19b103d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Flow 'volume_create_manager' (e1de89e0-053b-4ec2-8336-097e1a53927b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5a4738-cec7-4ad0-93a4-cde236960182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-470ac989-7582-41cb-b48f-fa45f4d7b9d6', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41cd9fce-9e96-4d8c-bea7-15d1a53c9463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:18 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Volume volume-470ac989-7582-41cb-b48f-fa45f4d7b9d6 (470ac989-7582-41cb-b48f-fa45f4d7b9d6): created successfully Apr 02 12:37:18 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41cd9fce-9e96-4d8c-bea7-15d1a53c9463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:18 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Flow 'volume_create_manager' (c8ae1801-59ba-4990-bfb2-32adbea41fe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:37:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-067e844b-dddb-4fc3-a54e-00564ee0de36-f95b7f6a-8796-4473-aa04-81afee3bf964" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:18 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Creating volume f95b7f6a-8796-4473-aa04-81afee3bf964 from snapshot 067e844b-dddb-4fc3-a54e-00564ee0de36 {{(pid=82819) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 02 12:37:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:18 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:37:18 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:37:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:18 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:37:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "cinder-quobyte-f95b7f6a-8796-4473-aa04-81afee3bf964" by "_copy_volume_from_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:18 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-6c4db656-c89c-4349-9840-321b8d6adc1d tempest-VolumesActionsTest-1564126816 None] Created volume successfully. Apr 02 12:37:18 devstack cinder-volume[82819]: INFO cinder.volume.manager [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-062c4054-a713-47d0-afeb-c495af3695bb tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Created volume successfully. Apr 02 12:37:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-f95b7f6a-8796-4473-aa04-81afee3bf964" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:18 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] snapshot: 067e844b-dddb-4fc3-a54e-00564ee0de36, volume: f95b7f6a-8796-4473-aa04-81afee3bf964, {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 12:37:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:18 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:37:18 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:37:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:18 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[da554102-d853-4d86-87b4-0f37a1697e9f]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:37:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.067e844b-dddb-4fc3-a54e-00564ee0de36 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1c7e57e6-4ada-44e2-a6c6-8d1434ac7cf2 tempest-VolumesActionsTest-1564126816 None] Acquiring lock "cinder-470ac989-7582-41cb-b48f-fa45f4d7b9d6" by "attach_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1c7e57e6-4ada-44e2-a6c6-8d1434ac7cf2 tempest-VolumesActionsTest-1564126816 None] Lock "cinder-470ac989-7582-41cb-b48f-fa45f4d7b9d6" acquired by "attach_volume" :: waited 0.019s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:18 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-1c7e57e6-4ada-44e2-a6c6-8d1434ac7cf2 tempest-VolumesActionsTest-1564126816 None] Attaching volume 470ac989-7582-41cb-b48f-fa45f4d7b9d6 to instance c24b6642-f0cb-4496-b9d4-195b5ef3f848 at mountpoint /dev/vdb on host None. Apr 02 12:37:18 devstack sudo[85444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.067e844b-dddb-4fc3-a54e-00564ee0de36 Apr 02 12:37:18 devstack sudo[85444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:18 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-1c7e57e6-4ada-44e2-a6c6-8d1434ac7cf2 tempest-VolumesActionsTest-1564126816 None] Attach volume completed successfully. Apr 02 12:37:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1c7e57e6-4ada-44e2-a6c6-8d1434ac7cf2 tempest-VolumesActionsTest-1564126816 None] Lock "cinder-470ac989-7582-41cb-b48f-fa45f4d7b9d6" released by "attach_volume" :: held 0.152s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-90c59f72-ba36-4ff2-83ff-a89392fee0c0 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:19 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-4e11eb10-95ff-41ad-9772-3caf975e6764 tempest-VolumesActionsTest-1469405713 None] Terminate volume connection completed successfully. Apr 02 12:37:19 devstack sudo[85444]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.067e844b-dddb-4fc3-a54e-00564ee0de36" returned: 0 in 1.692s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:19 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05197a10-d090-4d5e-992a-90cee9466b4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:37:19 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 12:37:19 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Creating direct copy from snapshot {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 12:37:19 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf34ab17-4594-4a19-bcfe-05796c07bc1d]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:37:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:19 devstack sudo[85474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e Apr 02 12:37:19 devstack sudo[85474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:20 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-4e11eb10-95ff-41ad-9772-3caf975e6764 tempest-VolumesActionsTest-1469405713 None] Acquiring lock "cinder-470ac989-7582-41cb-b48f-fa45f4d7b9d6-detach_volume" by "detach_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:20 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-4e11eb10-95ff-41ad-9772-3caf975e6764 tempest-VolumesActionsTest-1469405713 None] Lock "cinder-470ac989-7582-41cb-b48f-fa45f4d7b9d6-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:20 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-4e11eb10-95ff-41ad-9772-3caf975e6764 tempest-VolumesActionsTest-1469405713 None] Detaching volume 470ac989-7582-41cb-b48f-fa45f4d7b9d6 from instance c24b6642-f0cb-4496-b9d4-195b5ef3f848. Apr 02 12:37:20 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-4e11eb10-95ff-41ad-9772-3caf975e6764 tempest-VolumesActionsTest-1469405713 None] Detach volume completed successfully. Apr 02 12:37:20 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-4e11eb10-95ff-41ad-9772-3caf975e6764 tempest-VolumesActionsTest-1469405713 None] Lock "cinder-470ac989-7582-41cb-b48f-fa45f4d7b9d6-detach_volume" released by "detach_volume" :: held 0.204s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:20 devstack sudo[85474]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e" returned: 0 in 0.938s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:20 devstack cinder-volume[82819]: DEBUG cinder.utils [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Path /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f95b7f6a-8796-4473-aa04-81afee3bf964 not found in is_blk_device check {{(pid=82819) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 12:37:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f95b7f6a-8796-4473-aa04-81afee3bf964 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:20 devstack sudo[85479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f95b7f6a-8796-4473-aa04-81afee3bf964 Apr 02 12:37:20 devstack sudo[85479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:20 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-06aad8df-4211-48ad-8665-a4fab78c75dd tempest-VolumesActionsTest-1564126816 None] Acquiring lock "cinder-470ac989-7582-41cb-b48f-fa45f4d7b9d6-detach_volume" by "detach_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:20 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-06aad8df-4211-48ad-8665-a4fab78c75dd tempest-VolumesActionsTest-1564126816 None] Lock "cinder-470ac989-7582-41cb-b48f-fa45f4d7b9d6-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:20 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-06aad8df-4211-48ad-8665-a4fab78c75dd tempest-VolumesActionsTest-1564126816 None] Volume detach called, but volume not attached. Apr 02 12:37:20 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-06aad8df-4211-48ad-8665-a4fab78c75dd tempest-VolumesActionsTest-1564126816 None] Lock "cinder-470ac989-7582-41cb-b48f-fa45f4d7b9d6-detach_volume" released by "detach_volume" :: held 0.024s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:21 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a3b6a903-e1aa-48d1-b4e5-2ed5e26ed0d5 tempest-VolumesActionsTest-1564126816 None] Acquiring lock "cinder-470ac989-7582-41cb-b48f-fa45f4d7b9d6-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:21 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a3b6a903-e1aa-48d1-b4e5-2ed5e26ed0d5 tempest-VolumesActionsTest-1564126816 None] Lock "cinder-470ac989-7582-41cb-b48f-fa45f4d7b9d6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:22 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a3b6a903-e1aa-48d1-b4e5-2ed5e26ed0d5 tempest-VolumesActionsTest-1564126816 None] Acquiring lock "cinder-quobyte-470ac989-7582-41cb-b48f-fa45f4d7b9d6" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:22 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a3b6a903-e1aa-48d1-b4e5-2ed5e26ed0d5 tempest-VolumesActionsTest-1564126816 None] Lock "cinder-quobyte-470ac989-7582-41cb-b48f-fa45f4d7b9d6" acquired by "delete_volume" :: waited 0.023s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:22 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e259e468-e2e6-4ff7-aeb7-7655e7cf899c]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:37:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3b6a903-e1aa-48d1-b4e5-2ed5e26ed0d5 tempest-VolumesActionsTest-1564126816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-470ac989-7582-41cb-b48f-fa45f4d7b9d6 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:22 devstack sudo[85494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-470ac989-7582-41cb-b48f-fa45f4d7b9d6 Apr 02 12:37:22 devstack sudo[85494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:24 devstack sudo[85479]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f95b7f6a-8796-4473-aa04-81afee3bf964" returned: 0 in 4.024s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:24 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffd9ac0-348c-41e4-8613-f92a6ac1b069]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:37:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:24 devstack sudo[85502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e Apr 02 12:37:24 devstack sudo[85502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:24 devstack sudo[85494]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3b6a903-e1aa-48d1-b4e5-2ed5e26ed0d5 tempest-VolumesActionsTest-1564126816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-470ac989-7582-41cb-b48f-fa45f4d7b9d6" returned: 0 in 2.743s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3b6a903-e1aa-48d1-b4e5-2ed5e26ed0d5 tempest-VolumesActionsTest-1564126816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-470ac989-7582-41cb-b48f-fa45f4d7b9d6 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:24 devstack sudo[85504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-470ac989-7582-41cb-b48f-fa45f4d7b9d6 Apr 02 12:37:24 devstack sudo[85504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:25 devstack sudo[85504]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3b6a903-e1aa-48d1-b4e5-2ed5e26ed0d5 tempest-VolumesActionsTest-1564126816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-470ac989-7582-41cb-b48f-fa45f4d7b9d6" returned: 0 in 0.489s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:25 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a3b6a903-e1aa-48d1-b4e5-2ed5e26ed0d5 tempest-VolumesActionsTest-1564126816 None] Lock "cinder-quobyte-470ac989-7582-41cb-b48f-fa45f4d7b9d6" released by "delete_volume" :: held 3.314s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:25 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-a3b6a903-e1aa-48d1-b4e5-2ed5e26ed0d5 tempest-VolumesActionsTest-1564126816 None] Created reservations ['49a6d52e-0ec9-4d6b-b9c5-b2a84d30683b', '2a90afda-963b-4637-87f6-b2ed5ad9c6cc', '1bd84130-826e-403f-8850-c75986535c60', '92e9692d-7e30-41b7-98a9-312f462d8e62'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:37:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a3b6a903-e1aa-48d1-b4e5-2ed5e26ed0d5 tempest-VolumesActionsTest-1564126816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a3b6a903-e1aa-48d1-b4e5-2ed5e26ed0d5 tempest-VolumesActionsTest-1564126816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:25 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a3b6a903-e1aa-48d1-b4e5-2ed5e26ed0d5 tempest-VolumesActionsTest-1564126816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:37:25 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a3b6a903-e1aa-48d1-b4e5-2ed5e26ed0d5 tempest-VolumesActionsTest-1564126816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:37:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a3b6a903-e1aa-48d1-b4e5-2ed5e26ed0d5 tempest-VolumesActionsTest-1564126816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3b6a903-e1aa-48d1-b4e5-2ed5e26ed0d5 tempest-VolumesActionsTest-1564126816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:25 devstack sudo[85533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:37:25 devstack sudo[85533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:25 devstack sudo[85502]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e" returned: 0 in 1.012s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:25 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e, size 1024.00 MB, duration 4.03 sec, destination /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f95b7f6a-8796-4473-aa04-81afee3bf964 {{(pid=82819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 12:37:25 devstack cinder-volume[82819]: INFO cinder.image.image_utils [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Converted 1024.00 MB image at 254.38 MB/s Apr 02 12:37:25 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f95b7f6a-8796-4473-aa04-81afee3bf964 is being set with open permissions: ugo+rw Apr 02 12:37:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f95b7f6a-8796-4473-aa04-81afee3bf964 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:25 devstack sudo[85537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f95b7f6a-8796-4473-aa04-81afee3bf964 Apr 02 12:37:25 devstack sudo[85537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:26 devstack sudo[85533]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3b6a903-e1aa-48d1-b4e5-2ed5e26ed0d5 tempest-VolumesActionsTest-1564126816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 1.176s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:26 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-a3b6a903-e1aa-48d1-b4e5-2ed5e26ed0d5 tempest-VolumesActionsTest-1564126816 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:37:26 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-a3b6a903-e1aa-48d1-b4e5-2ed5e26ed0d5 tempest-VolumesActionsTest-1564126816 None] Deleted volume successfully. Apr 02 12:37:26 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a3b6a903-e1aa-48d1-b4e5-2ed5e26ed0d5 tempest-VolumesActionsTest-1564126816 None] Lock "cinder-470ac989-7582-41cb-b48f-fa45f4d7b9d6-delete_volume" released by "delete_volume" :: held 5.004s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:26 devstack sudo[85537]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f95b7f6a-8796-4473-aa04-81afee3bf964" returned: 0 in 1.145s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:27 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-f95b7f6a-8796-4473-aa04-81afee3bf964" released by "_copy_volume_from_snapshot" :: held 8.970s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:27 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-067e844b-dddb-4fc3-a54e-00564ee0de36-f95b7f6a-8796-4473-aa04-81afee3bf964" released by "_create_volume_from_snapshot" :: held 9.004s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.051s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-90c59f72-ba36-4ff2-83ff-a89392fee0c0 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.634s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:27 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f5aa26-75f8-469f-9e7a-dee91742cb64]: (4, 'raw') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:37:27 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a976a0ae-d854-4b15-bc10-e9c2a478cc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f95b7f6a-8796-4473-aa04-81afee3bf964', 'volume_size': 2, 'snapshot_id': '067e844b-dddb-4fc3-a54e-00564ee0de36'}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:27 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a115819a-dfe8-44f0-9da2-06d92fb5c918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-90c59f72-ba36-4ff2-83ff-a89392fee0c0 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:27 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Volume volume-f95b7f6a-8796-4473-aa04-81afee3bf964 (f95b7f6a-8796-4473-aa04-81afee3bf964): created successfully Apr 02 12:37:27 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a115819a-dfe8-44f0-9da2-06d92fb5c918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:27 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Flow 'volume_create_manager' (be7cae60-6265-4ce9-8847-351f0d59647d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:37:27 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-3d95d3df-c897-462e-a4b7-e1fe2e25889e tempest-VolumesSnapshotTestJSON-793399911 None] Created volume successfully. Apr 02 12:37:27 devstack sudo[85545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d Apr 02 12:37:27 devstack sudo[85545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:28 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-34e62b3b-2b2f-4284-81ae-3b816c746118 tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "cinder-f95b7f6a-8796-4473-aa04-81afee3bf964-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:28 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-34e62b3b-2b2f-4284-81ae-3b816c746118 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-f95b7f6a-8796-4473-aa04-81afee3bf964-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:28 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-34e62b3b-2b2f-4284-81ae-3b816c746118 tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "cinder-quobyte-f95b7f6a-8796-4473-aa04-81afee3bf964" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:28 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-34e62b3b-2b2f-4284-81ae-3b816c746118 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-f95b7f6a-8796-4473-aa04-81afee3bf964" acquired by "delete_volume" :: waited 0.024s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:28 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33e913e-fcfe-45ac-94d7-c4f0c2c624c0]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:37:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-34e62b3b-2b2f-4284-81ae-3b816c746118 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f95b7f6a-8796-4473-aa04-81afee3bf964 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:28 devstack sudo[85575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f95b7f6a-8796-4473-aa04-81afee3bf964 Apr 02 12:37:28 devstack sudo[85575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:28 devstack sudo[85545]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-90c59f72-ba36-4ff2-83ff-a89392fee0c0 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d" returned: 0 in 1.775s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-90c59f72-ba36-4ff2-83ff-a89392fee0c0 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:29 devstack sudo[85578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d Apr 02 12:37:29 devstack sudo[85578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:30 devstack sudo[85578]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-90c59f72-ba36-4ff2-83ff-a89392fee0c0 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d" returned: 1 in 1.201s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-90c59f72-ba36-4ff2-83ff-a89392fee0c0 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d' failed. Not Retrying. {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 12:37:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-90c59f72-ba36-4ff2-83ff-a89392fee0c0 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.082s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-90c59f72-ba36-4ff2-83ff-a89392fee0c0 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea', 'name': 'volume-911394f4-ca98-42cc-b340-e530f74ec96d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ac93267-3f2f-41e2-b5a4-a0070d8cff5e', 'enforce_multipath': True} {{(pid=82819) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 02 12:37:30 devstack sudo[85575]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-34e62b3b-2b2f-4284-81ae-3b816c746118 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f95b7f6a-8796-4473-aa04-81afee3bf964" returned: 0 in 1.466s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-34e62b3b-2b2f-4284-81ae-3b816c746118 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f95b7f6a-8796-4473-aa04-81afee3bf964 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:30 devstack sudo[85589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f95b7f6a-8796-4473-aa04-81afee3bf964 Apr 02 12:37:30 devstack sudo[85589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:30 devstack cinder-volume[82819]: INFO cinder.volume.manager [req-3484c1ba-1b46-45d5-af5a-8285968ed97c req-90c59f72-ba36-4ff2-83ff-a89392fee0c0 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] attachment_update completed successfully. Apr 02 12:37:30 devstack sudo[85589]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-34e62b3b-2b2f-4284-81ae-3b816c746118 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f95b7f6a-8796-4473-aa04-81afee3bf964" returned: 0 in 0.662s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:30 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-34e62b3b-2b2f-4284-81ae-3b816c746118 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-f95b7f6a-8796-4473-aa04-81afee3bf964" released by "delete_volume" :: held 2.258s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:30 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-34e62b3b-2b2f-4284-81ae-3b816c746118 tempest-VolumesSnapshotTestJSON-793399911 None] Created reservations ['11f7a486-74c5-4c79-87bc-7d642f45dd76', '5ee4e69c-0e9e-44ac-b7dc-aa40d2dc1777', '926aa29d-5ae6-4136-bc79-1893d1a3a9cb', '8ff37d95-7014-491b-8d70-b2ec69b59cf0'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:37:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-34e62b3b-2b2f-4284-81ae-3b816c746118 tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-34e62b3b-2b2f-4284-81ae-3b816c746118 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:30 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-34e62b3b-2b2f-4284-81ae-3b816c746118 tempest-VolumesSnapshotTestJSON-793399911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:37:30 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-34e62b3b-2b2f-4284-81ae-3b816c746118 tempest-VolumesSnapshotTestJSON-793399911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:37:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-34e62b3b-2b2f-4284-81ae-3b816c746118 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-34e62b3b-2b2f-4284-81ae-3b816c746118 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:31 devstack sudo[85617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:37:31 devstack sudo[85617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:31 devstack sudo[85617]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-34e62b3b-2b2f-4284-81ae-3b816c746118 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.591s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:31 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-34e62b3b-2b2f-4284-81ae-3b816c746118 tempest-VolumesSnapshotTestJSON-793399911 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:37:31 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-34e62b3b-2b2f-4284-81ae-3b816c746118 tempest-VolumesSnapshotTestJSON-793399911 None] Deleted volume successfully. Apr 02 12:37:31 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-34e62b3b-2b2f-4284-81ae-3b816c746118 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-f95b7f6a-8796-4473-aa04-81afee3bf964-delete_volume" released by "delete_volume" :: held 3.141s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:31 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-fa003a5e-0d91-419b-809f-fb6382ce9bd8 tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "cinder-067e844b-dddb-4fc3-a54e-00564ee0de36-delete_snapshot" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:31 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-fa003a5e-0d91-419b-809f-fb6382ce9bd8 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-067e844b-dddb-4fc3-a54e-00564ee0de36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:31 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-fa003a5e-0d91-419b-809f-fb6382ce9bd8 tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "cinder-quobyte-05197a10-d090-4d5e-992a-90cee9466b4e" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:31 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-fa003a5e-0d91-419b-809f-fb6382ce9bd8 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-05197a10-d090-4d5e-992a-90cee9466b4e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:31 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-fa003a5e-0d91-419b-809f-fb6382ce9bd8 tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "cinder-quobyte-067e844b-dddb-4fc3-a54e-00564ee0de36" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:31 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-fa003a5e-0d91-419b-809f-fb6382ce9bd8 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-067e844b-dddb-4fc3-a54e-00564ee0de36" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:31 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-fa003a5e-0d91-419b-809f-fb6382ce9bd8 tempest-VolumesSnapshotTestJSON-793399911 None] Deleting offline snapshot 067e844b-dddb-4fc3-a54e-00564ee0de36 of volume 05197a10-d090-4d5e-992a-90cee9466b4e {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:37:31 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-fa003a5e-0d91-419b-809f-fb6382ce9bd8 tempest-VolumesSnapshotTestJSON-793399911 None] snapshot_file for this snap is: volume-05197a10-d090-4d5e-992a-90cee9466b4e.067e844b-dddb-4fc3-a54e-00564ee0de36 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:37:31 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[104dbeea-0610-44b0-b132-fcbe6647acc8]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:37:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fa003a5e-0d91-419b-809f-fb6382ce9bd8 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.067e844b-dddb-4fc3-a54e-00564ee0de36 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:32 devstack sudo[85623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.067e844b-dddb-4fc3-a54e-00564ee0de36 Apr 02 12:37:32 devstack sudo[85623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:32 devstack sudo[85623]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fa003a5e-0d91-419b-809f-fb6382ce9bd8 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.067e844b-dddb-4fc3-a54e-00564ee0de36" returned: 0 in 0.736s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-fa003a5e-0d91-419b-809f-fb6382ce9bd8 tempest-VolumesSnapshotTestJSON-793399911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05197a10-d090-4d5e-992a-90cee9466b4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:37:32 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ca2abd-4e4a-4288-a700-9b54ea41945f]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:37:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fa003a5e-0d91-419b-809f-fb6382ce9bd8 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:32 devstack sudo[85629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e Apr 02 12:37:32 devstack sudo[85629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:33 devstack sudo[85629]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fa003a5e-0d91-419b-809f-fb6382ce9bd8 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e" returned: 0 in 0.575s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fa003a5e-0d91-419b-809f-fb6382ce9bd8 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.067e844b-dddb-4fc3-a54e-00564ee0de36 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:33 devstack sudo[85638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.067e844b-dddb-4fc3-a54e-00564ee0de36 Apr 02 12:37:33 devstack sudo[85638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:33 devstack sudo[85638]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fa003a5e-0d91-419b-809f-fb6382ce9bd8 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.067e844b-dddb-4fc3-a54e-00564ee0de36" returned: 0 in 0.601s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fa003a5e-0d91-419b-809f-fb6382ce9bd8 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.067e844b-dddb-4fc3-a54e-00564ee0de36 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:33 devstack sudo[85643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.067e844b-dddb-4fc3-a54e-00564ee0de36 Apr 02 12:37:33 devstack sudo[85643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:34 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:37:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Flow 'volume_create_manager' (04950dd2-c44e-4304-a7f6-2f102f73697f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:37:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f7c1210-8004-4575-bccd-717cb3c209eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f7c1210-8004-4575-bccd-717cb3c209eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-756680677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=403d762b-63c3-4729-9466-54cbac2c4d2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7f355ba2fa49898dd2462006b4d097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:37:34Z,use_quota=True,user_id='4f8a8be9251548f88774d3bc62622c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e319aa-65d7-4ab5-800c-6d082c09aca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e319aa-65d7-4ab5-800c-6d082c09aca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (255a0372-93ee-4e58-8d71-9e54d62b329c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (255a0372-93ee-4e58-8d71-9e54d62b329c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '403d762b-63c3-4729-9466-54cbac2c4d2c', 'volume_name': 'volume-403d762b-63c3-4729-9466-54cbac2c4d2c', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecefeefb-74b2-47b7-84d2-ea1edf16b6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecefeefb-74b2-47b7-84d2-ea1edf16b6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa557e67-cc4c-40d9-a956-b29ea06141f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:34 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Volume 403d762b-63c3-4729-9466-54cbac2c4d2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-403d762b-63c3-4729-9466-54cbac2c4d2c', 'volume_size': 1} Apr 02 12:37:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-756680677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=403d762b-63c3-4729-9466-54cbac2c4d2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7f355ba2fa49898dd2462006b4d097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:37:34Z,use_quota=True,user_id='4f8a8be9251548f88774d3bc62622c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:37:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Creating volume 403d762b-63c3-4729-9466-54cbac2c4d2c {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:37:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:37:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:37:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:37:34 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:37:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-403d762b-63c3-4729-9466-54cbac2c4d2c 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:34 devstack sudo[85646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-403d762b-63c3-4729-9466-54cbac2c4d2c 1073741824 Apr 02 12:37:34 devstack sudo[85646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:34 devstack sudo[85643]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fa003a5e-0d91-419b-809f-fb6382ce9bd8 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e.067e844b-dddb-4fc3-a54e-00564ee0de36" returned: 0 in 0.525s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-fa003a5e-0d91-419b-809f-fb6382ce9bd8 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-067e844b-dddb-4fc3-a54e-00564ee0de36" released by "_delete_snapshot" :: held 2.548s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-fa003a5e-0d91-419b-809f-fb6382ce9bd8 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-05197a10-d090-4d5e-992a-90cee9466b4e" released by "delete_snapshot" :: held 2.575s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:34 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-fa003a5e-0d91-419b-809f-fb6382ce9bd8 tempest-VolumesSnapshotTestJSON-793399911 None] Created reservations ['367c963a-3a30-4579-9f36-673f26b136ea', 'f4323029-cc95-4e39-ac0d-799d08b50a48', '4ffdfe81-a36b-42f9-abf0-a8b67f76ee69', 'e72011c8-af3b-4fef-ac4d-0479f0571b53'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:37:34 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-fa003a5e-0d91-419b-809f-fb6382ce9bd8 tempest-VolumesSnapshotTestJSON-793399911 None] Delete snapshot completed successfully. Apr 02 12:37:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-fa003a5e-0d91-419b-809f-fb6382ce9bd8 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-067e844b-dddb-4fc3-a54e-00564ee0de36-delete_snapshot" released by "delete_snapshot" :: held 2.687s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:35 devstack sudo[85646]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-403d762b-63c3-4729-9466-54cbac2c4d2c 1073741824" returned: 0 in 1.022s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:35 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6c3a1eda-6250-4cfd-a655-e5dbe8e1ab85 tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "cinder-05197a10-d090-4d5e-992a-90cee9466b4e-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:35 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6c3a1eda-6250-4cfd-a655-e5dbe8e1ab85 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-05197a10-d090-4d5e-992a-90cee9466b4e-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-403d762b-63c3-4729-9466-54cbac2c4d2c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:35 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6c3a1eda-6250-4cfd-a655-e5dbe8e1ab85 tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "cinder-quobyte-05197a10-d090-4d5e-992a-90cee9466b4e" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:35 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6c3a1eda-6250-4cfd-a655-e5dbe8e1ab85 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-05197a10-d090-4d5e-992a-90cee9466b4e" acquired by "delete_volume" :: waited 0.024s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:35 devstack sudo[85683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-403d762b-63c3-4729-9466-54cbac2c4d2c Apr 02 12:37:35 devstack sudo[85683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:35 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b672c9-30d4-4ade-8655-92d2101383b2]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:37:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6c3a1eda-6250-4cfd-a655-e5dbe8e1ab85 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:35 devstack sudo[85686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e Apr 02 12:37:35 devstack sudo[85686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:36 devstack sudo[85683]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-403d762b-63c3-4729-9466-54cbac2c4d2c" returned: 0 in 1.200s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:36 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] <== create_volume: return (2439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:37:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.444s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa557e67-cc4c-40d9-a956-b29ea06141f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-403d762b-63c3-4729-9466-54cbac2c4d2c', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d834ec7-53d0-4741-8080-16508b22e75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:36 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Volume volume-403d762b-63c3-4729-9466-54cbac2c4d2c (403d762b-63c3-4729-9466-54cbac2c4d2c): created successfully Apr 02 12:37:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d834ec7-53d0-4741-8080-16508b22e75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Flow 'volume_create_manager' (04950dd2-c44e-4304-a7f6-2f102f73697f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:37:36 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-ce59d000-8450-444c-9862-0e8afeccfb8e tempest-VolumesActionsTest-1564126816 None] Created volume successfully. Apr 02 12:37:36 devstack sudo[85686]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6c3a1eda-6250-4cfd-a655-e5dbe8e1ab85 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e" returned: 0 in 1.259s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6c3a1eda-6250-4cfd-a655-e5dbe8e1ab85 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:36 devstack sudo[85701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e Apr 02 12:37:37 devstack sudo[85701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:37 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d37f4068-d0de-4919-9920-89a68a5e5e17 tempest-VolumesActionsTest-1469405713 None] Acquiring lock "cinder-403d762b-63c3-4729-9466-54cbac2c4d2c-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:37 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d37f4068-d0de-4919-9920-89a68a5e5e17 tempest-VolumesActionsTest-1469405713 None] Lock "cinder-403d762b-63c3-4729-9466-54cbac2c4d2c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:37 devstack sudo[85701]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:37 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d37f4068-d0de-4919-9920-89a68a5e5e17 tempest-VolumesActionsTest-1469405713 None] Acquiring lock "cinder-quobyte-403d762b-63c3-4729-9466-54cbac2c4d2c" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6c3a1eda-6250-4cfd-a655-e5dbe8e1ab85 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-05197a10-d090-4d5e-992a-90cee9466b4e" returned: 0 in 0.755s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:37 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d37f4068-d0de-4919-9920-89a68a5e5e17 tempest-VolumesActionsTest-1469405713 None] Lock "cinder-quobyte-403d762b-63c3-4729-9466-54cbac2c4d2c" acquired by "delete_volume" :: waited 0.033s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:37 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6c3a1eda-6250-4cfd-a655-e5dbe8e1ab85 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-05197a10-d090-4d5e-992a-90cee9466b4e" released by "delete_volume" :: held 2.141s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:37 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[927eaa6a-b63a-4846-b78c-4406b2ec75d6]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:37:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d37f4068-d0de-4919-9920-89a68a5e5e17 tempest-VolumesActionsTest-1469405713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-403d762b-63c3-4729-9466-54cbac2c4d2c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:37 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-6c3a1eda-6250-4cfd-a655-e5dbe8e1ab85 tempest-VolumesSnapshotTestJSON-793399911 None] Created reservations ['e0cacb65-f857-4afa-8502-618dc29bf3eb', '453be192-1ad0-40ea-a83a-e6666c90b8e0', 'd8b25646-dd66-46ed-9555-0759ab07f84b', '4a05e9cc-ef34-40a6-bc7c-93944f2a5843'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:37:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6c3a1eda-6250-4cfd-a655-e5dbe8e1ab85 tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6c3a1eda-6250-4cfd-a655-e5dbe8e1ab85 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:37 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6c3a1eda-6250-4cfd-a655-e5dbe8e1ab85 tempest-VolumesSnapshotTestJSON-793399911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:37:37 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6c3a1eda-6250-4cfd-a655-e5dbe8e1ab85 tempest-VolumesSnapshotTestJSON-793399911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:37:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6c3a1eda-6250-4cfd-a655-e5dbe8e1ab85 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6c3a1eda-6250-4cfd-a655-e5dbe8e1ab85 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:37 devstack sudo[85714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:37:37 devstack sudo[85714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:37 devstack sudo[85713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-403d762b-63c3-4729-9466-54cbac2c4d2c Apr 02 12:37:37 devstack sudo[85713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:38 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:37:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Flow 'volume_create_manager' (662164e7-5daa-4ce2-90b3-b0f4ffa00361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:37:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (725eb966-f136-4969-9c2c-0681f552616e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (725eb966-f136-4969-9c2c-0681f552616e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1239390924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d17fff08-8708-42c2-95e9-68b6c6f9d9c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='218fe4a563ba4546b904db512d45a6dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:37:39Z,use_quota=True,user_id='02f701db7c3c4681b969f6ea8ebee0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f786caa-f238-4ba3-bcec-83c9862d9b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f786caa-f238-4ba3-bcec-83c9862d9b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7624a687-85a4-460c-9477-b6fac5d78795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7624a687-85a4-460c-9477-b6fac5d78795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd17fff08-8708-42c2-95e9-68b6c6f9d9c0', 'volume_name': 'volume-d17fff08-8708-42c2-95e9-68b6c6f9d9c0', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3c62d5-627c-49fe-8905-a4dec2adae45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3c62d5-627c-49fe-8905-a4dec2adae45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf9c222-e761-4307-a88c-fbf594bb9966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:38 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Volume d17fff08-8708-42c2-95e9-68b6c6f9d9c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d17fff08-8708-42c2-95e9-68b6c6f9d9c0', 'volume_size': 1} Apr 02 12:37:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1239390924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d17fff08-8708-42c2-95e9-68b6c6f9d9c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='218fe4a563ba4546b904db512d45a6dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:37:39Z,use_quota=True,user_id='02f701db7c3c4681b969f6ea8ebee0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:37:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Creating volume d17fff08-8708-42c2-95e9-68b6c6f9d9c0 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:37:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:37:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:37:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:37:38 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:37:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d17fff08-8708-42c2-95e9-68b6c6f9d9c0 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:38 devstack sudo[85718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d17fff08-8708-42c2-95e9-68b6c6f9d9c0 1073741824 Apr 02 12:37:38 devstack sudo[85718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:38 devstack sudo[85714]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6c3a1eda-6250-4cfd-a655-e5dbe8e1ab85 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.833s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:38 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-6c3a1eda-6250-4cfd-a655-e5dbe8e1ab85 tempest-VolumesSnapshotTestJSON-793399911 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:37:38 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-6c3a1eda-6250-4cfd-a655-e5dbe8e1ab85 tempest-VolumesSnapshotTestJSON-793399911 None] Deleted volume successfully. Apr 02 12:37:38 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6c3a1eda-6250-4cfd-a655-e5dbe8e1ab85 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-05197a10-d090-4d5e-992a-90cee9466b4e-delete_volume" released by "delete_volume" :: held 3.329s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:39 devstack sudo[85713]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d37f4068-d0de-4919-9920-89a68a5e5e17 tempest-VolumesActionsTest-1469405713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-403d762b-63c3-4729-9466-54cbac2c4d2c" returned: 0 in 1.353s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d37f4068-d0de-4919-9920-89a68a5e5e17 tempest-VolumesActionsTest-1469405713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-403d762b-63c3-4729-9466-54cbac2c4d2c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:39 devstack sudo[85723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-403d762b-63c3-4729-9466-54cbac2c4d2c Apr 02 12:37:39 devstack sudo[85723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:39 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:37:39 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Flow 'volume_create_manager' (e150ced6-219e-47a7-8ad1-7cfb1601bfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:37:39 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d399b6f5-7ab5-4b96-b34a-ed2f7a675f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:39 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d399b6f5-7ab5-4b96-b34a-ed2f7a675f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-311148371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32301593-57f6-4890-bdbb-545e894cbb24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c9e78b8b5140a49cfc4984a3d0f7e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:37:40Z,use_quota=True,user_id='beb5e9a518c14980ade9a58efb599d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:39 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c93243d-5b62-46c2-abc8-4776c729fd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:39 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c93243d-5b62-46c2-abc8-4776c729fd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:39 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b50a8f9-88fe-4750-870e-690c6c116725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:39 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b50a8f9-88fe-4750-870e-690c6c116725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32301593-57f6-4890-bdbb-545e894cbb24', 'volume_name': 'volume-32301593-57f6-4890-bdbb-545e894cbb24', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:39 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cdb0625-96ae-4cd9-a238-d66f39110e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:39 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cdb0625-96ae-4cd9-a238-d66f39110e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:39 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06844b7-b5dd-4a81-8e1b-83516c238e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:39 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Volume 32301593-57f6-4890-bdbb-545e894cbb24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32301593-57f6-4890-bdbb-545e894cbb24', 'volume_size': 1} Apr 02 12:37:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:39 devstack sudo[85723]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d37f4068-d0de-4919-9920-89a68a5e5e17 tempest-VolumesActionsTest-1469405713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-403d762b-63c3-4729-9466-54cbac2c4d2c" returned: 0 in 0.838s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:39 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d37f4068-d0de-4919-9920-89a68a5e5e17 tempest-VolumesActionsTest-1469405713 None] Lock "cinder-quobyte-403d762b-63c3-4729-9466-54cbac2c4d2c" released by "delete_volume" :: held 2.252s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:40 devstack sudo[85718]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d17fff08-8708-42c2-95e9-68b6c6f9d9c0 1073741824" returned: 0 in 1.367s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-d37f4068-d0de-4919-9920-89a68a5e5e17 tempest-VolumesActionsTest-1469405713 None] Created reservations ['19e357fe-d54d-45c0-afd4-e407842d89b7', '43fe0081-9624-435c-b1a6-33173fb5b7a9', '36e4536d-8d30-4814-aa1f-a0581fd2b3ee', '0f308416-9a48-44d0-afeb-2570fb276cb3'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d17fff08-8708-42c2-95e9-68b6c6f9d9c0 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d37f4068-d0de-4919-9920-89a68a5e5e17 tempest-VolumesActionsTest-1469405713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d37f4068-d0de-4919-9920-89a68a5e5e17 tempest-VolumesActionsTest-1469405713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-d37f4068-d0de-4919-9920-89a68a5e5e17 tempest-VolumesActionsTest-1469405713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-d37f4068-d0de-4919-9920-89a68a5e5e17 tempest-VolumesActionsTest-1469405713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:37:40 devstack sudo[85730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d17fff08-8708-42c2-95e9-68b6c6f9d9c0 Apr 02 12:37:40 devstack sudo[85730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d37f4068-d0de-4919-9920-89a68a5e5e17 tempest-VolumesActionsTest-1469405713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d37f4068-d0de-4919-9920-89a68a5e5e17 tempest-VolumesActionsTest-1469405713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:40 devstack sudo[85732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:37:40 devstack sudo[85732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:40 devstack sudo[85732]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d37f4068-d0de-4919-9920-89a68a5e5e17 tempest-VolumesActionsTest-1469405713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.484s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-d37f4068-d0de-4919-9920-89a68a5e5e17 tempest-VolumesActionsTest-1469405713 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:37:40 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-d37f4068-d0de-4919-9920-89a68a5e5e17 tempest-VolumesActionsTest-1469405713 None] Deleted volume successfully. Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d37f4068-d0de-4919-9920-89a68a5e5e17 tempest-VolumesActionsTest-1469405713 None] Lock "cinder-403d762b-63c3-4729-9466-54cbac2c4d2c-delete_volume" released by "delete_volume" :: held 3.060s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:40 devstack sudo[85730]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d17fff08-8708-42c2-95e9-68b6c6f9d9c0" returned: 0 in 0.624s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] <== create_volume: return (2055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.057s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.119s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-311148371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32301593-57f6-4890-bdbb-545e894cbb24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c9e78b8b5140a49cfc4984a3d0f7e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:37:40Z,use_quota=True,user_id='beb5e9a518c14980ade9a58efb599d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Creating volume 32301593-57f6-4890-bdbb-545e894cbb24 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:37:40 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf9c222-e761-4307-a88c-fbf594bb9966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d17fff08-8708-42c2-95e9-68b6c6f9d9c0', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c8fbf13-ab95-410d-ad36-6bd67d7f4202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:40 devstack sudo[85736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24 1073741824 Apr 02 12:37:40 devstack sudo[85736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:40 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Volume volume-d17fff08-8708-42c2-95e9-68b6c6f9d9c0 (d17fff08-8708-42c2-95e9-68b6c6f9d9c0): created successfully Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c8fbf13-ab95-410d-ad36-6bd67d7f4202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:40 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Flow 'volume_create_manager' (662164e7-5daa-4ce2-90b3-b0f4ffa00361) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:37:40 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-50312c4c-f44e-429a-b44b-92a1b96b5e9f tempest-ServersNegativeTestJSON-1120665824 None] Created volume successfully. Apr 02 12:37:41 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:37:41 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Flow 'volume_create_manager' (5ec38d30-fbab-4ccc-908f-f38f3fc547a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:37:41 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0767fa6e-0b18-4b85-91a2-4de1c06dbbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:41 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0767fa6e-0b18-4b85-91a2-4de1c06dbbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-707035566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=016b1799-9d21-4b20-9104-b9f8367313fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7f355ba2fa49898dd2462006b4d097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:37:41Z,use_quota=True,user_id='4f8a8be9251548f88774d3bc62622c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:41 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc4c1b80-116b-45a0-adb5-0c4f1a6b91a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:41 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc4c1b80-116b-45a0-adb5-0c4f1a6b91a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:41 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4700eea5-1556-45a8-bda1-2d426ed8eb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:41 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4700eea5-1556-45a8-bda1-2d426ed8eb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '016b1799-9d21-4b20-9104-b9f8367313fe', 'volume_name': 'volume-016b1799-9d21-4b20-9104-b9f8367313fe', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:41 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aba6f4b-4e30-49c4-9d93-d21b0b8031b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:41 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aba6f4b-4e30-49c4-9d93-d21b0b8031b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:41 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c1f2ea-216d-4476-9dae-b41d9eabaa89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:41 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Volume 016b1799-9d21-4b20-9104-b9f8367313fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-016b1799-9d21-4b20-9104-b9f8367313fe', 'volume_size': 1} Apr 02 12:37:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:41 devstack sudo[85736]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24 1073741824" returned: 0 in 1.128s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:41 devstack sudo[85747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24 Apr 02 12:37:41 devstack sudo[85747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:42 devstack sudo[85747]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24" returned: 0 in 0.576s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:42 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:37:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.771s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:42 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-707035566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=016b1799-9d21-4b20-9104-b9f8367313fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7f355ba2fa49898dd2462006b4d097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:37:41Z,use_quota=True,user_id='4f8a8be9251548f88774d3bc62622c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:37:42 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Creating volume 016b1799-9d21-4b20-9104-b9f8367313fe {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:37:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:42 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:37:42 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:37:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:42 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:37:42 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:37:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-016b1799-9d21-4b20-9104-b9f8367313fe 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:42 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06844b7-b5dd-4a81-8e1b-83516c238e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32301593-57f6-4890-bdbb-545e894cbb24', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:42 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96c543bc-5e7a-4b0b-aeaf-d67b5138bae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:42 devstack sudo[85750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-016b1799-9d21-4b20-9104-b9f8367313fe 1073741824 Apr 02 12:37:42 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Volume volume-32301593-57f6-4890-bdbb-545e894cbb24 (32301593-57f6-4890-bdbb-545e894cbb24): created successfully Apr 02 12:37:42 devstack sudo[85750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:42 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96c543bc-5e7a-4b0b-aeaf-d67b5138bae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:42 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Flow 'volume_create_manager' (e150ced6-219e-47a7-8ad1-7cfb1601bfb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:37:42 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-cab1f7ac-8459-443e-b66c-019c46f838e2 tempest-VolumesSnapshotTestJSON-793399911 None] Created volume successfully. Apr 02 12:37:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-8177cfc1-6f53-428f-bd13-a2ade75b7612 tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:43 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:37:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Flow 'volume_create_manager' (ffad728d-8df5-4613-ae0b-8875d245ad21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:37:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (935f96a3-016c-426f-9d12-f2eb87184b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (935f96a3-016c-426f-9d12-f2eb87184b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1596015431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd4766c-8c67-4a57-bc45-9f550c0ec200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='218fe4a563ba4546b904db512d45a6dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:37:43Z,use_quota=True,user_id='02f701db7c3c4681b969f6ea8ebee0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3bcfd4e-0321-46e0-a0d0-3c11fff7d260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3bcfd4e-0321-46e0-a0d0-3c11fff7d260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (625d3c95-ede2-40a5-9dab-306fd47e33d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (625d3c95-ede2-40a5-9dab-306fd47e33d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dd4766c-8c67-4a57-bc45-9f550c0ec200', 'volume_name': 'volume-7dd4766c-8c67-4a57-bc45-9f550c0ec200', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39026812-25c2-457a-9499-fa325cb381b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39026812-25c2-457a-9499-fa325cb381b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb4c525-0f09-463b-95d2-f98a86166e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:43 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Volume 7dd4766c-8c67-4a57-bc45-9f550c0ec200: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dd4766c-8c67-4a57-bc45-9f550c0ec200', 'volume_size': 1} Apr 02 12:37:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:43 devstack sudo[85750]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-016b1799-9d21-4b20-9104-b9f8367313fe 1073741824" returned: 0 in 0.994s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-016b1799-9d21-4b20-9104-b9f8367313fe {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:43 devstack sudo[85756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-016b1799-9d21-4b20-9104-b9f8367313fe Apr 02 12:37:43 devstack sudo[85756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:44 devstack sudo[85756]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-016b1799-9d21-4b20-9104-b9f8367313fe" returned: 0 in 0.685s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:44 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:37:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-8177cfc1-6f53-428f-bd13-a2ade75b7612 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.113s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c1f2ea-216d-4476-9dae-b41d9eabaa89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-016b1799-9d21-4b20-9104-b9f8367313fe', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beed2293-b6b3-44ea-a591-9b4b0c688d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:44 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Volume volume-016b1799-9d21-4b20-9104-b9f8367313fe (016b1799-9d21-4b20-9104-b9f8367313fe): created successfully Apr 02 12:37:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beed2293-b6b3-44ea-a591-9b4b0c688d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Flow 'volume_create_manager' (5ec38d30-fbab-4ccc-908f-f38f3fc547a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:37:44 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-b82d2dcb-a653-4df4-9879-421aabef3a01 tempest-VolumesActionsTest-1564126816 None] Created volume successfully. Apr 02 12:37:44 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-8177cfc1-6f53-428f-bd13-a2ade75b7612 tempest-VolumesSnapshotTestJSON-793399911 None] Creating offline snapshot 4af87a3a-394e-49ae-932d-471f20bbaac7 of volume 32301593-57f6-4890-bdbb-545e894cbb24 {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:37:44 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f888bc51-1cab-41ef-bc4d-e37fb63590f0]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:37:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8177cfc1-6f53-428f-bd13-a2ade75b7612 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:44 devstack sudo[85784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24 Apr 02 12:37:44 devstack sudo[85784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-aaae28bc-4a11-402f-897e-0f9abc50ed42 tempest-VolumesActionsTest-1469405713 None] Acquiring lock "cinder-016b1799-9d21-4b20-9104-b9f8367313fe-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-aaae28bc-4a11-402f-897e-0f9abc50ed42 tempest-VolumesActionsTest-1469405713 None] Lock "cinder-016b1799-9d21-4b20-9104-b9f8367313fe-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-aaae28bc-4a11-402f-897e-0f9abc50ed42 tempest-VolumesActionsTest-1469405713 None] Acquiring lock "cinder-quobyte-016b1799-9d21-4b20-9104-b9f8367313fe" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-aaae28bc-4a11-402f-897e-0f9abc50ed42 tempest-VolumesActionsTest-1469405713 None] Lock "cinder-quobyte-016b1799-9d21-4b20-9104-b9f8367313fe" acquired by "delete_volume" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:44 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce60c41-72f2-4996-ac69-e0e6c39eede5]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:37:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-aaae28bc-4a11-402f-897e-0f9abc50ed42 tempest-VolumesActionsTest-1469405713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-016b1799-9d21-4b20-9104-b9f8367313fe {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:44 devstack sudo[85790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-016b1799-9d21-4b20-9104-b9f8367313fe Apr 02 12:37:44 devstack sudo[85790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:44 devstack sudo[85784]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8177cfc1-6f53-428f-bd13-a2ade75b7612 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24" returned: 0 in 0.637s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8177cfc1-6f53-428f-bd13-a2ade75b7612 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.4af87a3a-394e-49ae-932d-471f20bbaac7 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:44 devstack sudo[85792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.4af87a3a-394e-49ae-932d-471f20bbaac7 1G Apr 02 12:37:44 devstack sudo[85792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:45 devstack sudo[85790]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-aaae28bc-4a11-402f-897e-0f9abc50ed42 tempest-VolumesActionsTest-1469405713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-016b1799-9d21-4b20-9104-b9f8367313fe" returned: 0 in 0.636s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-aaae28bc-4a11-402f-897e-0f9abc50ed42 tempest-VolumesActionsTest-1469405713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-016b1799-9d21-4b20-9104-b9f8367313fe {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:45 devstack sudo[85800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-016b1799-9d21-4b20-9104-b9f8367313fe Apr 02 12:37:45 devstack sudo[85800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:45 devstack sudo[85792]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8177cfc1-6f53-428f-bd13-a2ade75b7612 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.4af87a3a-394e-49ae-932d-471f20bbaac7 1G" returned: 0 in 0.601s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8177cfc1-6f53-428f-bd13-a2ade75b7612 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32301593-57f6-4890-bdbb-545e894cbb24 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.4af87a3a-394e-49ae-932d-471f20bbaac7 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:45 devstack sudo[85802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32301593-57f6-4890-bdbb-545e894cbb24 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.4af87a3a-394e-49ae-932d-471f20bbaac7 Apr 02 12:37:45 devstack sudo[85802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:46 devstack sudo[85800]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-aaae28bc-4a11-402f-897e-0f9abc50ed42 tempest-VolumesActionsTest-1469405713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-016b1799-9d21-4b20-9104-b9f8367313fe" returned: 0 in 0.637s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:46 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-aaae28bc-4a11-402f-897e-0f9abc50ed42 tempest-VolumesActionsTest-1469405713 None] Lock "cinder-quobyte-016b1799-9d21-4b20-9104-b9f8367313fe" released by "delete_volume" :: held 1.298s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:46 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-aaae28bc-4a11-402f-897e-0f9abc50ed42 tempest-VolumesActionsTest-1469405713 None] Created reservations ['8623dffc-3994-423b-a669-74c569052ae2', '36c93ba8-2a53-450d-9c08-85458ba9a41e', '494e8217-3ff0-4b03-af67-e7d59e9854f4', '75299d13-5bda-42da-ac0a-d49bd396f489'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:37:46 devstack sudo[85802]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8177cfc1-6f53-428f-bd13-a2ade75b7612 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32301593-57f6-4890-bdbb-545e894cbb24 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.4af87a3a-394e-49ae-932d-471f20bbaac7" returned: 0 in 0.658s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:46 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-8177cfc1-6f53-428f-bd13-a2ade75b7612 tempest-VolumesSnapshotTestJSON-793399911 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.4af87a3a-394e-49ae-932d-471f20bbaac7 is being set with open permissions: ugo+rw Apr 02 12:37:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8177cfc1-6f53-428f-bd13-a2ade75b7612 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.4af87a3a-394e-49ae-932d-471f20bbaac7 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:46 devstack sudo[85825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.4af87a3a-394e-49ae-932d-471f20bbaac7 Apr 02 12:37:46 devstack sudo[85825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-aaae28bc-4a11-402f-897e-0f9abc50ed42 tempest-VolumesActionsTest-1469405713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-aaae28bc-4a11-402f-897e-0f9abc50ed42 tempest-VolumesActionsTest-1469405713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:46 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-aaae28bc-4a11-402f-897e-0f9abc50ed42 tempest-VolumesActionsTest-1469405713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:37:46 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-aaae28bc-4a11-402f-897e-0f9abc50ed42 tempest-VolumesActionsTest-1469405713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:37:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-aaae28bc-4a11-402f-897e-0f9abc50ed42 tempest-VolumesActionsTest-1469405713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-aaae28bc-4a11-402f-897e-0f9abc50ed42 tempest-VolumesActionsTest-1469405713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:46 devstack sudo[85828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:37:46 devstack sudo[85828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:46 devstack sudo[85825]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8177cfc1-6f53-428f-bd13-a2ade75b7612 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.4af87a3a-394e-49ae-932d-471f20bbaac7" returned: 0 in 0.507s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:46 devstack sudo[85828]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-aaae28bc-4a11-402f-897e-0f9abc50ed42 tempest-VolumesActionsTest-1469405713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.465s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:46 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-aaae28bc-4a11-402f-897e-0f9abc50ed42 tempest-VolumesActionsTest-1469405713 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:37:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8177cfc1-6f53-428f-bd13-a2ade75b7612 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:46 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-aaae28bc-4a11-402f-897e-0f9abc50ed42 tempest-VolumesActionsTest-1469405713 None] Deleted volume successfully. Apr 02 12:37:46 devstack sudo[85832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.info Apr 02 12:37:46 devstack sudo[85832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:46 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-aaae28bc-4a11-402f-897e-0f9abc50ed42 tempest-VolumesActionsTest-1469405713 None] Lock "cinder-016b1799-9d21-4b20-9104-b9f8367313fe-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:47 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:37:47 devstack sudo[85832]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Flow 'volume_create_manager' (3e14ef9e-e857-4a34-b4f9-a1cd97d5a671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:37:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b4ab992-5112-4ff0-9a68-15c9c86ed9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8177cfc1-6f53-428f-bd13-a2ade75b7612 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.info" returned: 0 in 0.594s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:47 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-8177cfc1-6f53-428f-bd13-a2ade75b7612 tempest-VolumesSnapshotTestJSON-793399911 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.info is being set with open permissions: ugo+rw Apr 02 12:37:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8177cfc1-6f53-428f-bd13-a2ade75b7612 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b4ab992-5112-4ff0-9a68-15c9c86ed9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-202581090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a14f07-ba82-4201-af64-5494ba8e2f2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7f355ba2fa49898dd2462006b4d097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:37:47Z,use_quota=True,user_id='4f8a8be9251548f88774d3bc62622c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:47 devstack sudo[85835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.info Apr 02 12:37:47 devstack sudo[85835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5a577c2-6776-4247-9e0f-78f32a748e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5a577c2-6776-4247-9e0f-78f32a748e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f5b9e4-5c68-4d7c-8eb1-fffe7e47b3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f5b9e4-5c68-4d7c-8eb1-fffe7e47b3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08a14f07-ba82-4201-af64-5494ba8e2f2d', 'volume_name': 'volume-08a14f07-ba82-4201-af64-5494ba8e2f2d', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be9d0e7-2715-4dea-ad69-02eb1d2f3dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be9d0e7-2715-4dea-ad69-02eb1d2f3dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262771f5-a6a7-4c70-9caf-c0a9f3ba7ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:47 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Volume 08a14f07-ba82-4201-af64-5494ba8e2f2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08a14f07-ba82-4201-af64-5494ba8e2f2d', 'volume_size': 1} Apr 02 12:37:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:47 devstack sudo[85835]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8177cfc1-6f53-428f-bd13-a2ade75b7612 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.info" returned: 0 in 0.424s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-8177cfc1-6f53-428f-bd13-a2ade75b7612 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.554s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.481s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:47 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1596015431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd4766c-8c67-4a57-bc45-9f550c0ec200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='218fe4a563ba4546b904db512d45a6dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:37:43Z,use_quota=True,user_id='02f701db7c3c4681b969f6ea8ebee0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:37:47 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Creating volume 7dd4766c-8c67-4a57-bc45-9f550c0ec200 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:37:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:47 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:37:47 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:37:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:47 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:37:47 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:37:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7dd4766c-8c67-4a57-bc45-9f550c0ec200 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:47 devstack sudo[85839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7dd4766c-8c67-4a57-bc45-9f550c0ec200 1073741824 Apr 02 12:37:47 devstack sudo[85839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:47 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-8177cfc1-6f53-428f-bd13-a2ade75b7612 tempest-VolumesSnapshotTestJSON-793399911 None] Create snapshot completed successfully Apr 02 12:37:48 devstack sudo[85839]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7dd4766c-8c67-4a57-bc45-9f550c0ec200 1073741824" returned: 0 in 0.614s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7dd4766c-8c67-4a57-bc45-9f550c0ec200 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:48 devstack sudo[85844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7dd4766c-8c67-4a57-bc45-9f550c0ec200 Apr 02 12:37:48 devstack sudo[85844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:48 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:37:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Flow 'volume_create_manager' (0331cb28-6a08-4933-babf-a05f43dd822d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:37:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a89f1661-3627-44e0-9e16-30035e547460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a89f1661-3627-44e0-9e16-30035e547460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1067310405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac157616-8e92-417e-b14a-80bf7747a665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c9e78b8b5140a49cfc4984a3d0f7e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4af87a3a-394e-49ae-932d-471f20bbaac7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:37:49Z,use_quota=True,user_id='beb5e9a518c14980ade9a58efb599d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50189934-a0cc-4411-b515-0501d2072866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50189934-a0cc-4411-b515-0501d2072866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb79025-774a-4f70-8feb-d719d36a0d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb79025-774a-4f70-8feb-d719d36a0d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ac157616-8e92-417e-b14a-80bf7747a665', 'volume_name': 'volume-ac157616-8e92-417e-b14a-80bf7747a665', 'volume_size': 1, 'snapshot_id': '4af87a3a-394e-49ae-932d-471f20bbaac7'}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c9f7eb1-5383-4cd2-b368-f8200505516b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c9f7eb1-5383-4cd2-b368-f8200505516b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e22087e-55f8-4629-bc9e-52a5b84d7ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:48 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Volume ac157616-8e92-417e-b14a-80bf7747a665: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ac157616-8e92-417e-b14a-80bf7747a665', 'volume_size': 1, 'snapshot_id': '4af87a3a-394e-49ae-932d-471f20bbaac7'} Apr 02 12:37:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:49 devstack sudo[85844]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7dd4766c-8c67-4a57-bc45-9f550c0ec200" returned: 0 in 0.563s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:49 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:37:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.605s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:49 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-202581090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a14f07-ba82-4201-af64-5494ba8e2f2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7f355ba2fa49898dd2462006b4d097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:37:47Z,use_quota=True,user_id='4f8a8be9251548f88774d3bc62622c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:37:49 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Creating volume 08a14f07-ba82-4201-af64-5494ba8e2f2d {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:37:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:49 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:37:49 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:37:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:49 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:37:49 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:37:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-08a14f07-ba82-4201-af64-5494ba8e2f2d 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:49 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb4c525-0f09-463b-95d2-f98a86166e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dd4766c-8c67-4a57-bc45-9f550c0ec200', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:49 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179e912e-99b1-4bec-823f-e7ff93b9a9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:49 devstack sudo[85848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-08a14f07-ba82-4201-af64-5494ba8e2f2d 1073741824 Apr 02 12:37:49 devstack sudo[85848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:49 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Volume volume-7dd4766c-8c67-4a57-bc45-9f550c0ec200 (7dd4766c-8c67-4a57-bc45-9f550c0ec200): created successfully Apr 02 12:37:49 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179e912e-99b1-4bec-823f-e7ff93b9a9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:49 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Flow 'volume_create_manager' (ffad728d-8df5-4613-ae0b-8875d245ad21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:37:49 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-c87b4163-9e00-4df5-ae3e-058d15030d89 tempest-ServersNegativeTestJSON-1120665824 None] Created volume successfully. Apr 02 12:37:49 devstack sudo[85848]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-08a14f07-ba82-4201-af64-5494ba8e2f2d 1073741824" returned: 0 in 0.536s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-08a14f07-ba82-4201-af64-5494ba8e2f2d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:49 devstack sudo[85853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-08a14f07-ba82-4201-af64-5494ba8e2f2d Apr 02 12:37:49 devstack sudo[85853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:49 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1a7823e6-a890-4a65-b04d-2ceb952741e7 tempest-ServersNegativeTestJSON-1120665824 None] Acquiring lock "cinder-7dd4766c-8c67-4a57-bc45-9f550c0ec200-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:49 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1a7823e6-a890-4a65-b04d-2ceb952741e7 tempest-ServersNegativeTestJSON-1120665824 None] Lock "cinder-7dd4766c-8c67-4a57-bc45-9f550c0ec200-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:49 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1a7823e6-a890-4a65-b04d-2ceb952741e7 tempest-ServersNegativeTestJSON-1120665824 None] Acquiring lock "cinder-quobyte-7dd4766c-8c67-4a57-bc45-9f550c0ec200" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:49 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1a7823e6-a890-4a65-b04d-2ceb952741e7 tempest-ServersNegativeTestJSON-1120665824 None] Lock "cinder-quobyte-7dd4766c-8c67-4a57-bc45-9f550c0ec200" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2b6d36-4adb-4262-9d69-2458e4a30bbc]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1a7823e6-a890-4a65-b04d-2ceb952741e7 tempest-ServersNegativeTestJSON-1120665824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7dd4766c-8c67-4a57-bc45-9f550c0ec200 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:50 devstack sudo[85853]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-08a14f07-ba82-4201-af64-5494ba8e2f2d" returned: 0 in 0.496s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.239s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "cinder-quobyte-4af87a3a-394e-49ae-932d-471f20bbaac7-ac157616-8e92-417e-b14a-80bf7747a665" by "_create_volume_from_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:50 devstack sudo[85856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7dd4766c-8c67-4a57-bc45-9f550c0ec200 Apr 02 12:37:50 devstack sudo[85856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-4af87a3a-394e-49ae-932d-471f20bbaac7-ac157616-8e92-417e-b14a-80bf7747a665" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Creating volume ac157616-8e92-417e-b14a-80bf7747a665 from snapshot 4af87a3a-394e-49ae-932d-471f20bbaac7 {{(pid=82819) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "cinder-quobyte-ac157616-8e92-417e-b14a-80bf7747a665" by "_copy_volume_from_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262771f5-a6a7-4c70-9caf-c0a9f3ba7ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08a14f07-ba82-4201-af64-5494ba8e2f2d', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a27826-bb24-4300-b0b9-00070766a0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:50 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Volume volume-08a14f07-ba82-4201-af64-5494ba8e2f2d (08a14f07-ba82-4201-af64-5494ba8e2f2d): created successfully Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a27826-bb24-4300-b0b9-00070766a0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Flow 'volume_create_manager' (3e14ef9e-e857-4a34-b4f9-a1cd97d5a671) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-ac157616-8e92-417e-b14a-80bf7747a665" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] snapshot: 4af87a3a-394e-49ae-932d-471f20bbaac7, volume: ac157616-8e92-417e-b14a-80bf7747a665, {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 12:37:50 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-e136d70b-1297-41a8-9d07-6ea6678c898f tempest-VolumesActionsTest-1564126816 None] Created volume successfully. Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61b0b35-1ca5-4b9b-909a-ff46f4520466]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.4af87a3a-394e-49ae-932d-471f20bbaac7 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:50 devstack sudo[85858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.4af87a3a-394e-49ae-932d-471f20bbaac7 Apr 02 12:37:50 devstack sudo[85858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:50 devstack sudo[85856]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1a7823e6-a890-4a65-b04d-2ceb952741e7 tempest-ServersNegativeTestJSON-1120665824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7dd4766c-8c67-4a57-bc45-9f550c0ec200" returned: 0 in 0.818s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1a7823e6-a890-4a65-b04d-2ceb952741e7 tempest-ServersNegativeTestJSON-1120665824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7dd4766c-8c67-4a57-bc45-9f550c0ec200 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7f4b98f5-682a-45a2-ad0d-08d2ff6bc2e5 tempest-VolumesActionsTest-1469405713 None] Acquiring lock "cinder-08a14f07-ba82-4201-af64-5494ba8e2f2d-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:50 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7f4b98f5-682a-45a2-ad0d-08d2ff6bc2e5 tempest-VolumesActionsTest-1469405713 None] Lock "cinder-08a14f07-ba82-4201-af64-5494ba8e2f2d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:50 devstack sudo[85890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7dd4766c-8c67-4a57-bc45-9f550c0ec200 Apr 02 12:37:50 devstack sudo[85890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7f4b98f5-682a-45a2-ad0d-08d2ff6bc2e5 tempest-VolumesActionsTest-1469405713 None] Acquiring lock "cinder-quobyte-08a14f07-ba82-4201-af64-5494ba8e2f2d" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7f4b98f5-682a-45a2-ad0d-08d2ff6bc2e5 tempest-VolumesActionsTest-1469405713 None] Lock "cinder-quobyte-08a14f07-ba82-4201-af64-5494ba8e2f2d" acquired by "delete_volume" :: waited 0.031s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:51 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5c52f5-b466-4091-99ab-45daca7760df]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:37:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7f4b98f5-682a-45a2-ad0d-08d2ff6bc2e5 tempest-VolumesActionsTest-1469405713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-08a14f07-ba82-4201-af64-5494ba8e2f2d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:51 devstack sudo[85894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-08a14f07-ba82-4201-af64-5494ba8e2f2d Apr 02 12:37:51 devstack sudo[85894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:51 devstack sudo[85858]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.4af87a3a-394e-49ae-932d-471f20bbaac7" returned: 0 in 1.067s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:51 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32301593-57f6-4890-bdbb-545e894cbb24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:37:51 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24 {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 12:37:51 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Creating direct copy from snapshot {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 12:37:51 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ec81ee-0cba-4522-95ed-028155984b61]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:37:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:51 devstack sudo[85898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24 Apr 02 12:37:51 devstack sudo[85898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:51 devstack sudo[85890]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1a7823e6-a890-4a65-b04d-2ceb952741e7 tempest-ServersNegativeTestJSON-1120665824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7dd4766c-8c67-4a57-bc45-9f550c0ec200" returned: 0 in 0.774s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1a7823e6-a890-4a65-b04d-2ceb952741e7 tempest-ServersNegativeTestJSON-1120665824 None] Lock "cinder-quobyte-7dd4766c-8c67-4a57-bc45-9f550c0ec200" released by "delete_volume" :: held 1.627s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:51 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-1a7823e6-a890-4a65-b04d-2ceb952741e7 tempest-ServersNegativeTestJSON-1120665824 None] Created reservations ['a377d910-217f-46e7-8541-66925b521400', '9107fa8d-d340-4f22-876f-fcf3c8a39ff3', '80e071e8-4f5e-4c34-b6a5-0f3ea83e77ae', 'bae51c81-2997-49da-b6de-f54af3659caf'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:37:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-1a7823e6-a890-4a65-b04d-2ceb952741e7 tempest-ServersNegativeTestJSON-1120665824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-1a7823e6-a890-4a65-b04d-2ceb952741e7 tempest-ServersNegativeTestJSON-1120665824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:51 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-1a7823e6-a890-4a65-b04d-2ceb952741e7 tempest-ServersNegativeTestJSON-1120665824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:37:51 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-1a7823e6-a890-4a65-b04d-2ceb952741e7 tempest-ServersNegativeTestJSON-1120665824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:37:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-1a7823e6-a890-4a65-b04d-2ceb952741e7 tempest-ServersNegativeTestJSON-1120665824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1a7823e6-a890-4a65-b04d-2ceb952741e7 tempest-ServersNegativeTestJSON-1120665824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:51 devstack sudo[85904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:37:51 devstack sudo[85904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:51 devstack sudo[85894]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7f4b98f5-682a-45a2-ad0d-08d2ff6bc2e5 tempest-VolumesActionsTest-1469405713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-08a14f07-ba82-4201-af64-5494ba8e2f2d" returned: 0 in 0.659s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7f4b98f5-682a-45a2-ad0d-08d2ff6bc2e5 tempest-VolumesActionsTest-1469405713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-08a14f07-ba82-4201-af64-5494ba8e2f2d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:51 devstack sudo[85909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-08a14f07-ba82-4201-af64-5494ba8e2f2d Apr 02 12:37:51 devstack sudo[85909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:51 devstack sudo[85898]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24" returned: 0 in 0.621s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:51 devstack cinder-volume[82819]: DEBUG cinder.utils [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Path /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ac157616-8e92-417e-b14a-80bf7747a665 not found in is_blk_device check {{(pid=82819) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 12:37:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ac157616-8e92-417e-b14a-80bf7747a665 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:51 devstack sudo[85911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ac157616-8e92-417e-b14a-80bf7747a665 Apr 02 12:37:51 devstack sudo[85911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:52 devstack sudo[85904]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:52 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7a88920c-63c3-4e4e-b636-c3ab0dcad989 tempest-ServersNegativeTestJSON-1120665824 None] Acquiring lock "cinder-d17fff08-8708-42c2-95e9-68b6c6f9d9c0-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1a7823e6-a890-4a65-b04d-2ceb952741e7 tempest-ServersNegativeTestJSON-1120665824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.548s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:52 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-1a7823e6-a890-4a65-b04d-2ceb952741e7 tempest-ServersNegativeTestJSON-1120665824 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:37:52 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7a88920c-63c3-4e4e-b636-c3ab0dcad989 tempest-ServersNegativeTestJSON-1120665824 None] Lock "cinder-d17fff08-8708-42c2-95e9-68b6c6f9d9c0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:52 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-1a7823e6-a890-4a65-b04d-2ceb952741e7 tempest-ServersNegativeTestJSON-1120665824 None] Deleted volume successfully. Apr 02 12:37:52 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1a7823e6-a890-4a65-b04d-2ceb952741e7 tempest-ServersNegativeTestJSON-1120665824 None] Lock "cinder-7dd4766c-8c67-4a57-bc45-9f550c0ec200-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:52 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7a88920c-63c3-4e4e-b636-c3ab0dcad989 tempest-ServersNegativeTestJSON-1120665824 None] Acquiring lock "cinder-quobyte-d17fff08-8708-42c2-95e9-68b6c6f9d9c0" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:52 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7a88920c-63c3-4e4e-b636-c3ab0dcad989 tempest-ServersNegativeTestJSON-1120665824 None] Lock "cinder-quobyte-d17fff08-8708-42c2-95e9-68b6c6f9d9c0" acquired by "delete_volume" :: waited 0.015s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:52 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd630c6-519e-4e51-946c-b84855a229dc]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:37:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7a88920c-63c3-4e4e-b636-c3ab0dcad989 tempest-ServersNegativeTestJSON-1120665824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d17fff08-8708-42c2-95e9-68b6c6f9d9c0 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:52 devstack sudo[85909]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7f4b98f5-682a-45a2-ad0d-08d2ff6bc2e5 tempest-VolumesActionsTest-1469405713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-08a14f07-ba82-4201-af64-5494ba8e2f2d" returned: 0 in 0.699s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:52 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7f4b98f5-682a-45a2-ad0d-08d2ff6bc2e5 tempest-VolumesActionsTest-1469405713 None] Lock "cinder-quobyte-08a14f07-ba82-4201-af64-5494ba8e2f2d" released by "delete_volume" :: held 1.412s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:52 devstack sudo[85915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d17fff08-8708-42c2-95e9-68b6c6f9d9c0 Apr 02 12:37:52 devstack sudo[85915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:52 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-7f4b98f5-682a-45a2-ad0d-08d2ff6bc2e5 tempest-VolumesActionsTest-1469405713 None] Created reservations ['318b875b-2958-4f3e-9db6-03b009a2949c', '491599f0-414e-4a07-9cac-9c424ea067e4', 'ea7fe5ba-21b0-4639-96eb-2b0e0cd5f572', '0659b092-ea4a-4eb3-b044-c7878299022a'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:37:52 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:SELECT=110,cinder:UPDATE=103,cinder:DELETE=14,cinder:INSERT=37 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:37:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7f4b98f5-682a-45a2-ad0d-08d2ff6bc2e5 tempest-VolumesActionsTest-1469405713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7f4b98f5-682a-45a2-ad0d-08d2ff6bc2e5 tempest-VolumesActionsTest-1469405713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:52 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7f4b98f5-682a-45a2-ad0d-08d2ff6bc2e5 tempest-VolumesActionsTest-1469405713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:37:52 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7f4b98f5-682a-45a2-ad0d-08d2ff6bc2e5 tempest-VolumesActionsTest-1469405713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:37:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7f4b98f5-682a-45a2-ad0d-08d2ff6bc2e5 tempest-VolumesActionsTest-1469405713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7f4b98f5-682a-45a2-ad0d-08d2ff6bc2e5 tempest-VolumesActionsTest-1469405713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:52 devstack sudo[85921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:37:52 devstack sudo[85921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:54 devstack sudo[85921]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7f4b98f5-682a-45a2-ad0d-08d2ff6bc2e5 tempest-VolumesActionsTest-1469405713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 1.674s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:54 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-7f4b98f5-682a-45a2-ad0d-08d2ff6bc2e5 tempest-VolumesActionsTest-1469405713 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:37:54 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-7f4b98f5-682a-45a2-ad0d-08d2ff6bc2e5 tempest-VolumesActionsTest-1469405713 None] Deleted volume successfully. Apr 02 12:37:54 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:SELECT=107,cinder:UPDATE=120,cinder:INSERT=27,cinder:DELETE=7 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:37:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7f4b98f5-682a-45a2-ad0d-08d2ff6bc2e5 tempest-VolumesActionsTest-1469405713 None] Lock "cinder-08a14f07-ba82-4201-af64-5494ba8e2f2d-delete_volume" released by "delete_volume" :: held 3.573s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:54 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:37:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Flow 'volume_create_manager' (d905420b-dbbe-49a5-9a0f-2ccfb73273ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:37:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72053483-45f1-4da8-94b0-962485bbec8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:54 devstack sudo[85915]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72053483-45f1-4da8-94b0-962485bbec8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-989137796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e25fde83-f713-4aa5-b6f4-d3bb0bb2f411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7f355ba2fa49898dd2462006b4d097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:37:55Z,use_quota=True,user_id='4f8a8be9251548f88774d3bc62622c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (942fce41-12fb-4ccf-b3ad-e96fae201054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (942fce41-12fb-4ccf-b3ad-e96fae201054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f355566-d84d-4008-981c-6c753da10384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f355566-d84d-4008-981c-6c753da10384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e25fde83-f713-4aa5-b6f4-d3bb0bb2f411', 'volume_name': 'volume-e25fde83-f713-4aa5-b6f4-d3bb0bb2f411', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee4ce6b-df8a-42da-bd44-d71ca5781e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee4ce6b-df8a-42da-bd44-d71ca5781e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be50b90-634f-46df-a3f1-c4c6cba2e1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:55 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Volume e25fde83-f713-4aa5-b6f4-d3bb0bb2f411: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e25fde83-f713-4aa5-b6f4-d3bb0bb2f411', 'volume_size': 1} Apr 02 12:37:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7a88920c-63c3-4e4e-b636-c3ab0dcad989 tempest-ServersNegativeTestJSON-1120665824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d17fff08-8708-42c2-95e9-68b6c6f9d9c0" returned: 0 in 2.596s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7a88920c-63c3-4e4e-b636-c3ab0dcad989 tempest-ServersNegativeTestJSON-1120665824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d17fff08-8708-42c2-95e9-68b6c6f9d9c0 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:55 devstack sudo[85976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d17fff08-8708-42c2-95e9-68b6c6f9d9c0 Apr 02 12:37:55 devstack sudo[85976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:55 devstack sudo[85911]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ac157616-8e92-417e-b14a-80bf7747a665" returned: 0 in 3.703s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:55 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfd7590-e342-4155-bb0f-f19d6b58f54c]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:37:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:55 devstack sudo[85978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24 Apr 02 12:37:55 devstack sudo[85978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:55 devstack sudo[85976]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7a88920c-63c3-4e4e-b636-c3ab0dcad989 tempest-ServersNegativeTestJSON-1120665824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d17fff08-8708-42c2-95e9-68b6c6f9d9c0" returned: 0 in 0.922s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:55 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7a88920c-63c3-4e4e-b636-c3ab0dcad989 tempest-ServersNegativeTestJSON-1120665824 None] Lock "cinder-quobyte-d17fff08-8708-42c2-95e9-68b6c6f9d9c0" released by "delete_volume" :: held 3.546s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:55 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-7a88920c-63c3-4e4e-b636-c3ab0dcad989 tempest-ServersNegativeTestJSON-1120665824 None] Created reservations ['87ef4df5-40a0-4ba9-8619-e982cface5ff', '5ec6b2ae-5bf6-4b04-a31c-4e8737d77932', '08aa84b2-022c-4cd8-9f25-407c61e648a4', 'aea12e60-8104-4f92-9b40-e22a4bdd7383'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:37:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7a88920c-63c3-4e4e-b636-c3ab0dcad989 tempest-ServersNegativeTestJSON-1120665824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7a88920c-63c3-4e4e-b636-c3ab0dcad989 tempest-ServersNegativeTestJSON-1120665824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:56 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7a88920c-63c3-4e4e-b636-c3ab0dcad989 tempest-ServersNegativeTestJSON-1120665824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:37:56 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7a88920c-63c3-4e4e-b636-c3ab0dcad989 tempest-ServersNegativeTestJSON-1120665824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:37:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7a88920c-63c3-4e4e-b636-c3ab0dcad989 tempest-ServersNegativeTestJSON-1120665824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7a88920c-63c3-4e4e-b636-c3ab0dcad989 tempest-ServersNegativeTestJSON-1120665824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:56 devstack sudo[85981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:37:56 devstack sudo[85981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:56 devstack sudo[85978]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24" returned: 0 in 1.164s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:56 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24, size 1024.00 MB, duration 3.70 sec, destination /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ac157616-8e92-417e-b14a-80bf7747a665 {{(pid=82819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 12:37:56 devstack cinder-volume[82819]: INFO cinder.image.image_utils [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Converted 1024.00 MB image at 276.45 MB/s Apr 02 12:37:56 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ac157616-8e92-417e-b14a-80bf7747a665 is being set with open permissions: ugo+rw Apr 02 12:37:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ac157616-8e92-417e-b14a-80bf7747a665 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:56 devstack sudo[85994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ac157616-8e92-417e-b14a-80bf7747a665 Apr 02 12:37:56 devstack sudo[85994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:56 devstack sudo[85981]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7a88920c-63c3-4e4e-b636-c3ab0dcad989 tempest-ServersNegativeTestJSON-1120665824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.823s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:56 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-7a88920c-63c3-4e4e-b636-c3ab0dcad989 tempest-ServersNegativeTestJSON-1120665824 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:37:56 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-7a88920c-63c3-4e4e-b636-c3ab0dcad989 tempest-ServersNegativeTestJSON-1120665824 None] Deleted volume successfully. Apr 02 12:37:56 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7a88920c-63c3-4e4e-b636-c3ab0dcad989 tempest-ServersNegativeTestJSON-1120665824 None] Lock "cinder-d17fff08-8708-42c2-95e9-68b6c6f9d9c0-delete_volume" released by "delete_volume" :: held 4.589s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:57 devstack sudo[85994]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ac157616-8e92-417e-b14a-80bf7747a665" returned: 0 in 0.545s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:57 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-ac157616-8e92-417e-b14a-80bf7747a665" released by "_copy_volume_from_snapshot" :: held 7.193s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:57 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-4af87a3a-394e-49ae-932d-471f20bbaac7-ac157616-8e92-417e-b14a-80bf7747a665" released by "_create_volume_from_snapshot" :: held 7.237s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.250s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.336s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:57 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-989137796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e25fde83-f713-4aa5-b6f4-d3bb0bb2f411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7f355ba2fa49898dd2462006b4d097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:37:55Z,use_quota=True,user_id='4f8a8be9251548f88774d3bc62622c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:37:57 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Creating volume e25fde83-f713-4aa5-b6f4-d3bb0bb2f411 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:37:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:57 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:37:57 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:37:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:57 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:37:57 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:37:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e25fde83-f713-4aa5-b6f4-d3bb0bb2f411 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:57 devstack sudo[86017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e25fde83-f713-4aa5-b6f4-d3bb0bb2f411 1073741824 Apr 02 12:37:57 devstack sudo[86017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:57 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e22087e-55f8-4629-bc9e-52a5b84d7ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac157616-8e92-417e-b14a-80bf7747a665', 'volume_size': 1, 'snapshot_id': '4af87a3a-394e-49ae-932d-471f20bbaac7'}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:57 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31aa5098-fed7-4794-8c29-d6b957ef32f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:57 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Volume volume-ac157616-8e92-417e-b14a-80bf7747a665 (ac157616-8e92-417e-b14a-80bf7747a665): created successfully Apr 02 12:37:57 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31aa5098-fed7-4794-8c29-d6b957ef32f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:57 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Flow 'volume_create_manager' (0331cb28-6a08-4933-babf-a05f43dd822d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:37:57 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-0e87722c-23c7-444c-b051-16025736789d tempest-VolumesSnapshotTestJSON-793399911 None] Created volume successfully. Apr 02 12:37:57 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b2eeb210-0c1c-4689-af58-d86e6e67fb2b tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "cinder-ac157616-8e92-417e-b14a-80bf7747a665-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:57 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b2eeb210-0c1c-4689-af58-d86e6e67fb2b tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-ac157616-8e92-417e-b14a-80bf7747a665-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:58 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b2eeb210-0c1c-4689-af58-d86e6e67fb2b tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "cinder-quobyte-ac157616-8e92-417e-b14a-80bf7747a665" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:37:58 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b2eeb210-0c1c-4689-af58-d86e6e67fb2b tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-ac157616-8e92-417e-b14a-80bf7747a665" acquired by "delete_volume" :: waited 0.030s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:37:58 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a0cba2-97b8-4127-a69c-e446666c4eae]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:37:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b2eeb210-0c1c-4689-af58-d86e6e67fb2b tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ac157616-8e92-417e-b14a-80bf7747a665 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:58 devstack sudo[86017]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e25fde83-f713-4aa5-b6f4-d3bb0bb2f411 1073741824" returned: 0 in 0.764s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e25fde83-f713-4aa5-b6f4-d3bb0bb2f411 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:58 devstack sudo[86080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e25fde83-f713-4aa5-b6f4-d3bb0bb2f411 Apr 02 12:37:58 devstack sudo[86080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:58 devstack sudo[86079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ac157616-8e92-417e-b14a-80bf7747a665 Apr 02 12:37:58 devstack sudo[86079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:58 devstack sudo[86080]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e25fde83-f713-4aa5-b6f4-d3bb0bb2f411" returned: 0 in 0.726s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:58 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:37:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:58 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be50b90-634f-46df-a3f1-c4c6cba2e1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e25fde83-f713-4aa5-b6f4-d3bb0bb2f411', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:58 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb5d2296-4760-4efb-ae9c-56b94dcd8c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:37:58 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Volume volume-e25fde83-f713-4aa5-b6f4-d3bb0bb2f411 (e25fde83-f713-4aa5-b6f4-d3bb0bb2f411): created successfully Apr 02 12:37:58 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb5d2296-4760-4efb-ae9c-56b94dcd8c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:37:58 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Flow 'volume_create_manager' (d905420b-dbbe-49a5-9a0f-2ccfb73273ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:37:58 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-f2756d75-8d22-46c3-8edb-bd422cde3c0a tempest-VolumesActionsTest-1564126816 None] Created volume successfully. Apr 02 12:37:58 devstack sudo[86079]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b2eeb210-0c1c-4689-af58-d86e6e67fb2b tempest-VolumesSnapshotTestJSON-793399911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ac157616-8e92-417e-b14a-80bf7747a665" returned: 0 in 0.910s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b2eeb210-0c1c-4689-af58-d86e6e67fb2b tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ac157616-8e92-417e-b14a-80bf7747a665 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:59 devstack sudo[86091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ac157616-8e92-417e-b14a-80bf7747a665 Apr 02 12:37:59 devstack sudo[86091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:37:59 devstack sudo[86091]: pam_unix(sudo:session): session closed for user root Apr 02 12:37:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b2eeb210-0c1c-4689-af58-d86e6e67fb2b tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ac157616-8e92-417e-b14a-80bf7747a665" returned: 0 in 0.814s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:37:59 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b2eeb210-0c1c-4689-af58-d86e6e67fb2b tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-ac157616-8e92-417e-b14a-80bf7747a665" released by "delete_volume" :: held 1.759s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:37:59 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-b2eeb210-0c1c-4689-af58-d86e6e67fb2b tempest-VolumesSnapshotTestJSON-793399911 None] Created reservations ['21b9e6e9-4075-45f8-8616-dadb939b798d', 'c83c80e5-f985-4676-a941-0becb0dcec92', '2582c606-4f7c-4fe4-9047-5408663c37d0', '667fcfab-ca9c-4f14-b735-7e2ba7fbfba5'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:37:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b2eeb210-0c1c-4689-af58-d86e6e67fb2b tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:37:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b2eeb210-0c1c-4689-af58-d86e6e67fb2b tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:37:59 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b2eeb210-0c1c-4689-af58-d86e6e67fb2b tempest-VolumesSnapshotTestJSON-793399911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:37:59 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b2eeb210-0c1c-4689-af58-d86e6e67fb2b tempest-VolumesSnapshotTestJSON-793399911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:37:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b2eeb210-0c1c-4689-af58-d86e6e67fb2b tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:37:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b2eeb210-0c1c-4689-af58-d86e6e67fb2b tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:37:59 devstack sudo[86097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:37:59 devstack sudo[86097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a74d3509-9f73-4415-a4c8-4e1126561e7d tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "cinder-4af87a3a-394e-49ae-932d-471f20bbaac7-delete_snapshot" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-57d28116-d465-49aa-8f48-7157f8680143 tempest-VolumesActionsTest-1469405713 None] Acquiring lock "cinder-e25fde83-f713-4aa5-b6f4-d3bb0bb2f411-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a74d3509-9f73-4415-a4c8-4e1126561e7d tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-4af87a3a-394e-49ae-932d-471f20bbaac7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a74d3509-9f73-4415-a4c8-4e1126561e7d tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "cinder-quobyte-32301593-57f6-4890-bdbb-545e894cbb24" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a74d3509-9f73-4415-a4c8-4e1126561e7d tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-32301593-57f6-4890-bdbb-545e894cbb24" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a74d3509-9f73-4415-a4c8-4e1126561e7d tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "cinder-quobyte-4af87a3a-394e-49ae-932d-471f20bbaac7" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-57d28116-d465-49aa-8f48-7157f8680143 tempest-VolumesActionsTest-1469405713 None] Lock "cinder-e25fde83-f713-4aa5-b6f4-d3bb0bb2f411-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a74d3509-9f73-4415-a4c8-4e1126561e7d tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-4af87a3a-394e-49ae-932d-471f20bbaac7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:00 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-a74d3509-9f73-4415-a4c8-4e1126561e7d tempest-VolumesSnapshotTestJSON-793399911 None] Deleting offline snapshot 4af87a3a-394e-49ae-932d-471f20bbaac7 of volume 32301593-57f6-4890-bdbb-545e894cbb24 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:38:00 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-a74d3509-9f73-4415-a4c8-4e1126561e7d tempest-VolumesSnapshotTestJSON-793399911 None] snapshot_file for this snap is: volume-32301593-57f6-4890-bdbb-545e894cbb24.4af87a3a-394e-49ae-932d-471f20bbaac7 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:38:00 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[1173bdfc-84f9-4482-bf49-160481bdaf55]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a74d3509-9f73-4415-a4c8-4e1126561e7d tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.4af87a3a-394e-49ae-932d-471f20bbaac7 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-57d28116-d465-49aa-8f48-7157f8680143 tempest-VolumesActionsTest-1469405713 None] Acquiring lock "cinder-quobyte-e25fde83-f713-4aa5-b6f4-d3bb0bb2f411" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-57d28116-d465-49aa-8f48-7157f8680143 tempest-VolumesActionsTest-1469405713 None] Lock "cinder-quobyte-e25fde83-f713-4aa5-b6f4-d3bb0bb2f411" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:00 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0efbab7-e420-4511-9105-51efccc3bf4e]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-57d28116-d465-49aa-8f48-7157f8680143 tempest-VolumesActionsTest-1469405713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e25fde83-f713-4aa5-b6f4-d3bb0bb2f411 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:00 devstack sudo[86099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.4af87a3a-394e-49ae-932d-471f20bbaac7 Apr 02 12:38:00 devstack sudo[86099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:00 devstack sudo[86100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e25fde83-f713-4aa5-b6f4-d3bb0bb2f411 Apr 02 12:38:00 devstack sudo[86100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:00 devstack sudo[86097]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b2eeb210-0c1c-4689-af58-d86e6e67fb2b tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.623s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:00 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-b2eeb210-0c1c-4689-af58-d86e6e67fb2b tempest-VolumesSnapshotTestJSON-793399911 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:38:00 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-b2eeb210-0c1c-4689-af58-d86e6e67fb2b tempest-VolumesSnapshotTestJSON-793399911 None] Deleted volume successfully. Apr 02 12:38:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b2eeb210-0c1c-4689-af58-d86e6e67fb2b tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-ac157616-8e92-417e-b14a-80bf7747a665-delete_volume" released by "delete_volume" :: held 2.624s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:01 devstack sudo[86099]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a74d3509-9f73-4415-a4c8-4e1126561e7d tempest-VolumesSnapshotTestJSON-793399911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.4af87a3a-394e-49ae-932d-471f20bbaac7" returned: 0 in 0.681s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:01 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-a74d3509-9f73-4415-a4c8-4e1126561e7d tempest-VolumesSnapshotTestJSON-793399911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32301593-57f6-4890-bdbb-545e894cbb24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:38:01 devstack sudo[86100]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-57d28116-d465-49aa-8f48-7157f8680143 tempest-VolumesActionsTest-1469405713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e25fde83-f713-4aa5-b6f4-d3bb0bb2f411" returned: 0 in 0.631s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-57d28116-d465-49aa-8f48-7157f8680143 tempest-VolumesActionsTest-1469405713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e25fde83-f713-4aa5-b6f4-d3bb0bb2f411 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:01 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7989745f-171b-4d18-af32-a4b77fc93fb9]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a74d3509-9f73-4415-a4c8-4e1126561e7d tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:01 devstack sudo[86131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e25fde83-f713-4aa5-b6f4-d3bb0bb2f411 Apr 02 12:38:01 devstack sudo[86131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:01 devstack sudo[86132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24 Apr 02 12:38:01 devstack sudo[86132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:01 devstack sudo[86131]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-57d28116-d465-49aa-8f48-7157f8680143 tempest-VolumesActionsTest-1469405713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e25fde83-f713-4aa5-b6f4-d3bb0bb2f411" returned: 0 in 0.508s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:01 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-57d28116-d465-49aa-8f48-7157f8680143 tempest-VolumesActionsTest-1469405713 None] Lock "cinder-quobyte-e25fde83-f713-4aa5-b6f4-d3bb0bb2f411" released by "delete_volume" :: held 1.172s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:01 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-57d28116-d465-49aa-8f48-7157f8680143 tempest-VolumesActionsTest-1469405713 None] Created reservations ['bc56e76a-47a7-4e70-a011-249d90c476b9', '0c37d9ad-9d74-4ba4-9b09-9216cebfa9b5', '4fcc9fde-12dd-4429-8895-f75f508bda29', '31448d38-cdc5-4836-85ae-41f2032a4c3c'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:38:01 devstack sudo[86132]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a74d3509-9f73-4415-a4c8-4e1126561e7d tempest-VolumesSnapshotTestJSON-793399911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24" returned: 0 in 0.565s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a74d3509-9f73-4415-a4c8-4e1126561e7d tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.4af87a3a-394e-49ae-932d-471f20bbaac7 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:01 devstack sudo[86142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.4af87a3a-394e-49ae-932d-471f20bbaac7 Apr 02 12:38:01 devstack sudo[86142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-57d28116-d465-49aa-8f48-7157f8680143 tempest-VolumesActionsTest-1469405713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-57d28116-d465-49aa-8f48-7157f8680143 tempest-VolumesActionsTest-1469405713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:01 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-57d28116-d465-49aa-8f48-7157f8680143 tempest-VolumesActionsTest-1469405713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:38:01 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-57d28116-d465-49aa-8f48-7157f8680143 tempest-VolumesActionsTest-1469405713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:38:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-57d28116-d465-49aa-8f48-7157f8680143 tempest-VolumesActionsTest-1469405713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-57d28116-d465-49aa-8f48-7157f8680143 tempest-VolumesActionsTest-1469405713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:01 devstack sudo[86144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:38:01 devstack sudo[86144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:02 devstack sudo[86142]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a74d3509-9f73-4415-a4c8-4e1126561e7d tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.4af87a3a-394e-49ae-932d-471f20bbaac7" returned: 0 in 0.526s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a74d3509-9f73-4415-a4c8-4e1126561e7d tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.4af87a3a-394e-49ae-932d-471f20bbaac7 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:02 devstack sudo[86144]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-57d28116-d465-49aa-8f48-7157f8680143 tempest-VolumesActionsTest-1469405713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.489s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-57d28116-d465-49aa-8f48-7157f8680143 tempest-VolumesActionsTest-1469405713 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:38:02 devstack sudo[86151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.4af87a3a-394e-49ae-932d-471f20bbaac7 Apr 02 12:38:02 devstack sudo[86151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:02 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-57d28116-d465-49aa-8f48-7157f8680143 tempest-VolumesActionsTest-1469405713 None] Deleted volume successfully. Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-57d28116-d465-49aa-8f48-7157f8680143 tempest-VolumesActionsTest-1469405713 None] Lock "cinder-e25fde83-f713-4aa5-b6f4-d3bb0bb2f411-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:02 devstack sudo[86151]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a74d3509-9f73-4415-a4c8-4e1126561e7d tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24.4af87a3a-394e-49ae-932d-471f20bbaac7" returned: 0 in 0.499s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a74d3509-9f73-4415-a4c8-4e1126561e7d tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-4af87a3a-394e-49ae-932d-471f20bbaac7" released by "_delete_snapshot" :: held 2.367s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a74d3509-9f73-4415-a4c8-4e1126561e7d tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-32301593-57f6-4890-bdbb-545e894cbb24" released by "delete_snapshot" :: held 2.392s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-a74d3509-9f73-4415-a4c8-4e1126561e7d tempest-VolumesSnapshotTestJSON-793399911 None] Created reservations ['9c5a5a8f-da7c-4090-b988-b27ca5710109', '01106772-d5bb-4354-a48c-ecd0e7034d77', 'ff73b91e-f775-43ff-8ccb-673709cc1192', 'dd8188b7-2873-490c-9979-ca57add1ba25'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Flow 'volume_create_manager' (c3b8b1c3-e5f5-437e-bd3d-bd5b32da3e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc5bbf6c-577c-407a-b9ec-cf72535febda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc5bbf6c-577c-407a-b9ec-cf72535febda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-419304149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd941a3a-3c37-47ef-8198-9bac477d6277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7f355ba2fa49898dd2462006b4d097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:38:03Z,use_quota=True,user_id='4f8a8be9251548f88774d3bc62622c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f796c0-8035-46fc-81c7-40cc89234c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f796c0-8035-46fc-81c7-40cc89234c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d89eb36c-df8b-44af-bb57-42646f010bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d89eb36c-df8b-44af-bb57-42646f010bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd941a3a-3c37-47ef-8198-9bac477d6277', 'volume_name': 'volume-fd941a3a-3c37-47ef-8198-9bac477d6277', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd7a07d-8a66-4848-bdbe-8deb1a22d9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd7a07d-8a66-4848-bdbe-8deb1a22d9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e209e4b4-66a7-4083-98d8-6c66ce1b2ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:02 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Volume fd941a3a-3c37-47ef-8198-9bac477d6277: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd941a3a-3c37-47ef-8198-9bac477d6277', 'volume_size': 1} Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-419304149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd941a3a-3c37-47ef-8198-9bac477d6277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7f355ba2fa49898dd2462006b4d097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:38:03Z,use_quota=True,user_id='4f8a8be9251548f88774d3bc62622c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Creating volume fd941a3a-3c37-47ef-8198-9bac477d6277 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:38:02 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fd941a3a-3c37-47ef-8198-9bac477d6277 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:02 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-a74d3509-9f73-4415-a4c8-4e1126561e7d tempest-VolumesSnapshotTestJSON-793399911 None] Delete snapshot completed successfully. Apr 02 12:38:02 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a74d3509-9f73-4415-a4c8-4e1126561e7d tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-4af87a3a-394e-49ae-932d-471f20bbaac7-delete_snapshot" released by "delete_snapshot" :: held 2.640s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:02 devstack sudo[86173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fd941a3a-3c37-47ef-8198-9bac477d6277 1073741824 Apr 02 12:38:02 devstack sudo[86173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:03 devstack sudo[86173]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fd941a3a-3c37-47ef-8198-9bac477d6277 1073741824" returned: 0 in 0.608s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:03 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2f0d8255-49fb-4840-b1b0-e30edfca7ea5 tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "cinder-32301593-57f6-4890-bdbb-545e894cbb24-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fd941a3a-3c37-47ef-8198-9bac477d6277 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:03 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2f0d8255-49fb-4840-b1b0-e30edfca7ea5 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-32301593-57f6-4890-bdbb-545e894cbb24-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:03 devstack sudo[86178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fd941a3a-3c37-47ef-8198-9bac477d6277 Apr 02 12:38:03 devstack sudo[86178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:03 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2f0d8255-49fb-4840-b1b0-e30edfca7ea5 tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "cinder-quobyte-32301593-57f6-4890-bdbb-545e894cbb24" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:03 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2f0d8255-49fb-4840-b1b0-e30edfca7ea5 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-32301593-57f6-4890-bdbb-545e894cbb24" acquired by "delete_volume" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:03 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[484591da-c844-48f7-a9ac-b59337916b92]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2f0d8255-49fb-4840-b1b0-e30edfca7ea5 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:03 devstack cinder-volume[82819]: INFO cinder.volume.manager [req-fb7fd135-551b-4fa6-a082-ec556b898a2e req-5e995376-041a-4a76-9675-50014ffe30dd tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Terminate volume connection completed successfully. Apr 02 12:38:03 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-fb7fd135-551b-4fa6-a082-ec556b898a2e req-5e995376-041a-4a76-9675-50014ffe30dd tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Deleting attachment 6ac93267-3f2f-41e2-b5a4-a0070d8cff5e. {{(pid=82819) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 02 12:38:03 devstack sudo[86180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24 Apr 02 12:38:03 devstack sudo[86180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:04 devstack sudo[86178]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fd941a3a-3c37-47ef-8198-9bac477d6277" returned: 0 in 0.519s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:04 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:38:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e209e4b4-66a7-4083-98d8-6c66ce1b2ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd941a3a-3c37-47ef-8198-9bac477d6277', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92405675-0ee9-48b0-80cd-6965456bbcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:04 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Volume volume-fd941a3a-3c37-47ef-8198-9bac477d6277 (fd941a3a-3c37-47ef-8198-9bac477d6277): created successfully Apr 02 12:38:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92405675-0ee9-48b0-80cd-6965456bbcbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Flow 'volume_create_manager' (c3b8b1c3-e5f5-437e-bd3d-bd5b32da3e4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:38:04 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-8f4f46ff-b8bd-44d8-9b7b-0a1650956a66 tempest-VolumesActionsTest-1564126816 None] Created volume successfully. Apr 02 12:38:04 devstack sudo[86180]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2f0d8255-49fb-4840-b1b0-e30edfca7ea5 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24" returned: 0 in 0.524s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2f0d8255-49fb-4840-b1b0-e30edfca7ea5 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:04 devstack sudo[86193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24 Apr 02 12:38:04 devstack sudo[86193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:04 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-fb7fd135-551b-4fa6-a082-ec556b898a2e req-1aa45533-2b03-4354-94fe-6ec887581f22 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Acquiring lock "cinder-911394f4-ca98-42cc-b340-e530f74ec96d-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:04 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-fb7fd135-551b-4fa6-a082-ec556b898a2e req-1aa45533-2b03-4354-94fe-6ec887581f22 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Lock "cinder-911394f4-ca98-42cc-b340-e530f74ec96d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:04 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-fb7fd135-551b-4fa6-a082-ec556b898a2e req-1aa45533-2b03-4354-94fe-6ec887581f22 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Acquiring lock "cinder-quobyte-911394f4-ca98-42cc-b340-e530f74ec96d" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:04 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-fb7fd135-551b-4fa6-a082-ec556b898a2e req-1aa45533-2b03-4354-94fe-6ec887581f22 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Lock "cinder-quobyte-911394f4-ca98-42cc-b340-e530f74ec96d" acquired by "delete_volume" :: waited 0.014s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:04 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0e8340-0be0-4141-90a4-8e47f69d2617]: (4, 'raw') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-fb7fd135-551b-4fa6-a082-ec556b898a2e req-1aa45533-2b03-4354-94fe-6ec887581f22 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:04 devstack sudo[86200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d Apr 02 12:38:04 devstack sudo[86200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:04 devstack sudo[86193]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2f0d8255-49fb-4840-b1b0-e30edfca7ea5 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-32301593-57f6-4890-bdbb-545e894cbb24" returned: 0 in 0.560s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:04 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2f0d8255-49fb-4840-b1b0-e30edfca7ea5 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-32301593-57f6-4890-bdbb-545e894cbb24" released by "delete_volume" :: held 1.153s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:04 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-2f0d8255-49fb-4840-b1b0-e30edfca7ea5 tempest-VolumesSnapshotTestJSON-793399911 None] Created reservations ['693ac806-ac87-408f-b7c7-c12c22b35e92', 'cffbf62f-65fa-4967-972f-5321ef6dbf94', 'f42c05db-5521-46c0-8835-6405d46a3ac9', '6748304a-56aa-494f-87fa-afefe794f2c2'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:38:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2f0d8255-49fb-4840-b1b0-e30edfca7ea5 tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2f0d8255-49fb-4840-b1b0-e30edfca7ea5 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:04 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2f0d8255-49fb-4840-b1b0-e30edfca7ea5 tempest-VolumesSnapshotTestJSON-793399911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:38:04 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2f0d8255-49fb-4840-b1b0-e30edfca7ea5 tempest-VolumesSnapshotTestJSON-793399911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:38:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2f0d8255-49fb-4840-b1b0-e30edfca7ea5 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2f0d8255-49fb-4840-b1b0-e30edfca7ea5 tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:04 devstack sudo[86205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:38:04 devstack sudo[86205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:05 devstack sudo[86200]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-fb7fd135-551b-4fa6-a082-ec556b898a2e req-1aa45533-2b03-4354-94fe-6ec887581f22 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d" returned: 0 in 0.710s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-fb7fd135-551b-4fa6-a082-ec556b898a2e req-1aa45533-2b03-4354-94fe-6ec887581f22 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:05 devstack sudo[86209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d Apr 02 12:38:05 devstack sudo[86209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:05 devstack sudo[86205]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2f0d8255-49fb-4840-b1b0-e30edfca7ea5 tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.623s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:05 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-2f0d8255-49fb-4840-b1b0-e30edfca7ea5 tempest-VolumesSnapshotTestJSON-793399911 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:38:05 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-2f0d8255-49fb-4840-b1b0-e30edfca7ea5 tempest-VolumesSnapshotTestJSON-793399911 None] Deleted volume successfully. Apr 02 12:38:05 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2f0d8255-49fb-4840-b1b0-e30edfca7ea5 tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-32301593-57f6-4890-bdbb-545e894cbb24-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:05 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c2214adc-6663-42ce-9fdf-327c4bc9dfd3 tempest-VolumesActionsTest-1564126816 None] Acquiring lock "cinder-fd941a3a-3c37-47ef-8198-9bac477d6277-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:05 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c2214adc-6663-42ce-9fdf-327c4bc9dfd3 tempest-VolumesActionsTest-1564126816 None] Lock "cinder-fd941a3a-3c37-47ef-8198-9bac477d6277-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:05 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c2214adc-6663-42ce-9fdf-327c4bc9dfd3 tempest-VolumesActionsTest-1564126816 None] Acquiring lock "cinder-quobyte-fd941a3a-3c37-47ef-8198-9bac477d6277" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:05 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c2214adc-6663-42ce-9fdf-327c4bc9dfd3 tempest-VolumesActionsTest-1564126816 None] Lock "cinder-quobyte-fd941a3a-3c37-47ef-8198-9bac477d6277" acquired by "delete_volume" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:05 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4284f8-4b63-4a05-9e0f-fe3b132966cd]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c2214adc-6663-42ce-9fdf-327c4bc9dfd3 tempest-VolumesActionsTest-1564126816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fd941a3a-3c37-47ef-8198-9bac477d6277 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:05 devstack sudo[86212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fd941a3a-3c37-47ef-8198-9bac477d6277 Apr 02 12:38:05 devstack sudo[86212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:05 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3b16ed42-22ac-460a-b52a-b52cf81ee3da tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "cinder-1de41833-a040-4487-b30e-a12caa01c6d4-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:05 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3b16ed42-22ac-460a-b52a-b52cf81ee3da tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-1de41833-a040-4487-b30e-a12caa01c6d4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:05 devstack sudo[86209]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-fb7fd135-551b-4fa6-a082-ec556b898a2e req-1aa45533-2b03-4354-94fe-6ec887581f22 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d" returned: 1 in 0.826s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-fb7fd135-551b-4fa6-a082-ec556b898a2e req-1aa45533-2b03-4354-94fe-6ec887581f22 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d' failed. Not Retrying. {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 12:38:05 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3b16ed42-22ac-460a-b52a-b52cf81ee3da tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "cinder-quobyte-1de41833-a040-4487-b30e-a12caa01c6d4" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-fb7fd135-551b-4fa6-a082-ec556b898a2e req-1aa45533-2b03-4354-94fe-6ec887581f22 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:05 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3b16ed42-22ac-460a-b52a-b52cf81ee3da tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-1de41833-a040-4487-b30e-a12caa01c6d4" acquired by "delete_volume" :: waited 0.024s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:05 devstack sudo[86217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d Apr 02 12:38:05 devstack sudo[86217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:06 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[604476ee-c9fa-45f6-8b15-3615b86ae6da]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3b16ed42-22ac-460a-b52a-b52cf81ee3da tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:06 devstack sudo[86219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4 Apr 02 12:38:06 devstack sudo[86219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:06 devstack sudo[86212]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c2214adc-6663-42ce-9fdf-327c4bc9dfd3 tempest-VolumesActionsTest-1564126816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fd941a3a-3c37-47ef-8198-9bac477d6277" returned: 0 in 0.848s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c2214adc-6663-42ce-9fdf-327c4bc9dfd3 tempest-VolumesActionsTest-1564126816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fd941a3a-3c37-47ef-8198-9bac477d6277 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:06 devstack sudo[86225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fd941a3a-3c37-47ef-8198-9bac477d6277 Apr 02 12:38:06 devstack sudo[86225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:06 devstack sudo[86217]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-fb7fd135-551b-4fa6-a082-ec556b898a2e req-1aa45533-2b03-4354-94fe-6ec887581f22 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-911394f4-ca98-42cc-b340-e530f74ec96d" returned: 0 in 0.561s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:06 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-fb7fd135-551b-4fa6-a082-ec556b898a2e req-1aa45533-2b03-4354-94fe-6ec887581f22 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Lock "cinder-quobyte-911394f4-ca98-42cc-b340-e530f74ec96d" released by "delete_volume" :: held 2.171s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:06 devstack cinder-volume[82819]: DEBUG cinder.quota [req-fb7fd135-551b-4fa6-a082-ec556b898a2e req-1aa45533-2b03-4354-94fe-6ec887581f22 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Created reservations ['07679b3b-7844-4ff1-ac0f-4ebaa9540ab0', 'bf9060d1-2251-4508-accb-29b97cd96389', '7286afdb-c6ed-4060-bbf9-ef20360212de', 'ca691cbb-1444-4441-9ad6-ed1bd5efa7c3'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:38:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-fb7fd135-551b-4fa6-a082-ec556b898a2e req-1aa45533-2b03-4354-94fe-6ec887581f22 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-fb7fd135-551b-4fa6-a082-ec556b898a2e req-1aa45533-2b03-4354-94fe-6ec887581f22 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:06 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [req-fb7fd135-551b-4fa6-a082-ec556b898a2e req-1aa45533-2b03-4354-94fe-6ec887581f22 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:38:06 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [req-fb7fd135-551b-4fa6-a082-ec556b898a2e req-1aa45533-2b03-4354-94fe-6ec887581f22 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:38:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-fb7fd135-551b-4fa6-a082-ec556b898a2e req-1aa45533-2b03-4354-94fe-6ec887581f22 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-fb7fd135-551b-4fa6-a082-ec556b898a2e req-1aa45533-2b03-4354-94fe-6ec887581f22 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:06 devstack sudo[86231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:38:06 devstack sudo[86231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:06 devstack sudo[86219]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3b16ed42-22ac-460a-b52a-b52cf81ee3da tempest-VolumesSnapshotTestJSON-793399911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4" returned: 0 in 0.690s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3b16ed42-22ac-460a-b52a-b52cf81ee3da tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:06 devstack sudo[86233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4 Apr 02 12:38:06 devstack sudo[86233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:07 devstack sudo[86225]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c2214adc-6663-42ce-9fdf-327c4bc9dfd3 tempest-VolumesActionsTest-1564126816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fd941a3a-3c37-47ef-8198-9bac477d6277" returned: 0 in 0.678s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:07 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c2214adc-6663-42ce-9fdf-327c4bc9dfd3 tempest-VolumesActionsTest-1564126816 None] Lock "cinder-quobyte-fd941a3a-3c37-47ef-8198-9bac477d6277" released by "delete_volume" :: held 1.559s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:07 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-c2214adc-6663-42ce-9fdf-327c4bc9dfd3 tempest-VolumesActionsTest-1564126816 None] Created reservations ['ddf71940-1e67-46db-a011-f0dc8340875f', '250b8e25-e045-4c61-92a0-64dd1e387cbc', '2cdd3630-525f-43b8-aaae-60d15a80108d', '0c091b17-96df-4748-aecf-a9e5d7e88d58'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:38:07 devstack sudo[86231]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-fb7fd135-551b-4fa6-a082-ec556b898a2e req-1aa45533-2b03-4354-94fe-6ec887581f22 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.596s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:07 devstack cinder-volume[82819]: DEBUG cinder.manager [req-fb7fd135-551b-4fa6-a082-ec556b898a2e req-1aa45533-2b03-4354-94fe-6ec887581f22 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:38:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c2214adc-6663-42ce-9fdf-327c4bc9dfd3 tempest-VolumesActionsTest-1564126816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c2214adc-6663-42ce-9fdf-327c4bc9dfd3 tempest-VolumesActionsTest-1564126816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:07 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c2214adc-6663-42ce-9fdf-327c4bc9dfd3 tempest-VolumesActionsTest-1564126816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:38:07 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c2214adc-6663-42ce-9fdf-327c4bc9dfd3 tempest-VolumesActionsTest-1564126816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:38:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c2214adc-6663-42ce-9fdf-327c4bc9dfd3 tempest-VolumesActionsTest-1564126816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c2214adc-6663-42ce-9fdf-327c4bc9dfd3 tempest-VolumesActionsTest-1564126816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:07 devstack cinder-volume[82819]: INFO cinder.volume.manager [req-fb7fd135-551b-4fa6-a082-ec556b898a2e req-1aa45533-2b03-4354-94fe-6ec887581f22 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Deleted volume successfully. Apr 02 12:38:07 devstack sudo[86238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:38:07 devstack sudo[86238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:07 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-fb7fd135-551b-4fa6-a082-ec556b898a2e req-1aa45533-2b03-4354-94fe-6ec887581f22 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Lock "cinder-911394f4-ca98-42cc-b340-e530f74ec96d-delete_volume" released by "delete_volume" :: held 3.008s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:07 devstack sudo[86233]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3b16ed42-22ac-460a-b52a-b52cf81ee3da tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1de41833-a040-4487-b30e-a12caa01c6d4" returned: 0 in 0.590s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:07 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3b16ed42-22ac-460a-b52a-b52cf81ee3da tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-quobyte-1de41833-a040-4487-b30e-a12caa01c6d4" released by "delete_volume" :: held 1.354s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:07 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-3b16ed42-22ac-460a-b52a-b52cf81ee3da tempest-VolumesSnapshotTestJSON-793399911 None] Created reservations ['b010302f-2578-4c74-8fa4-9e6202850eb7', 'b5df7ee1-74f8-4245-a392-1676bcdcafde', 'faee386d-02d2-451d-9f53-dd334e72297e', '94bdb49d-cbb8-44d4-83e5-9debfbcb3414'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:38:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3b16ed42-22ac-460a-b52a-b52cf81ee3da tempest-VolumesSnapshotTestJSON-793399911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3b16ed42-22ac-460a-b52a-b52cf81ee3da tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:07 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3b16ed42-22ac-460a-b52a-b52cf81ee3da tempest-VolumesSnapshotTestJSON-793399911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:38:07 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3b16ed42-22ac-460a-b52a-b52cf81ee3da tempest-VolumesSnapshotTestJSON-793399911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:38:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3b16ed42-22ac-460a-b52a-b52cf81ee3da tempest-VolumesSnapshotTestJSON-793399911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3b16ed42-22ac-460a-b52a-b52cf81ee3da tempest-VolumesSnapshotTestJSON-793399911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:07 devstack sudo[86241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:38:07 devstack sudo[86241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:07 devstack sudo[86238]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c2214adc-6663-42ce-9fdf-327c4bc9dfd3 tempest-VolumesActionsTest-1564126816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.562s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:07 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-c2214adc-6663-42ce-9fdf-327c4bc9dfd3 tempest-VolumesActionsTest-1564126816 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:38:07 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-c2214adc-6663-42ce-9fdf-327c4bc9dfd3 tempest-VolumesActionsTest-1564126816 None] Deleted volume successfully. Apr 02 12:38:07 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c2214adc-6663-42ce-9fdf-327c4bc9dfd3 tempest-VolumesActionsTest-1564126816 None] Lock "cinder-fd941a3a-3c37-47ef-8198-9bac477d6277-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:08 devstack sudo[86241]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3b16ed42-22ac-460a-b52a-b52cf81ee3da tempest-VolumesSnapshotTestJSON-793399911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.530s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:08 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-3b16ed42-22ac-460a-b52a-b52cf81ee3da tempest-VolumesSnapshotTestJSON-793399911 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:38:08 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-3b16ed42-22ac-460a-b52a-b52cf81ee3da tempest-VolumesSnapshotTestJSON-793399911 None] Deleted volume successfully. Apr 02 12:38:08 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3b16ed42-22ac-460a-b52a-b52cf81ee3da tempest-VolumesSnapshotTestJSON-793399911 None] Lock "cinder-1de41833-a040-4487-b30e-a12caa01c6d4-delete_volume" released by "delete_volume" :: held 2.111s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:09 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:38:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Flow 'volume_create_manager' (635721e4-ae4c-4db2-8c34-9f9283b2bf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:38:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f8b5d4-8045-4b0b-a65d-0b211eda2474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f8b5d4-8045-4b0b-a65d-0b211eda2474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-116562989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1f00e38-db5c-4d9b-807e-1888a3f681c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b002bc55a9da4c5ab9c3e72eaabb0e28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:38:09Z,use_quota=True,user_id='2e6a2495db2f43519cd1349d400ebc6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0d4a9b-b32c-4faf-9168-8b08731db26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0d4a9b-b32c-4faf-9168-8b08731db26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e2f1dd-bdd2-4dd7-b88e-eaf102446e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e2f1dd-bdd2-4dd7-b88e-eaf102446e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1f00e38-db5c-4d9b-807e-1888a3f681c9', 'volume_name': 'volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579771db-1e8b-4344-ab66-1ebf740d8e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579771db-1e8b-4344-ab66-1ebf740d8e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fdff5d8-d0e9-49f4-8fb8-c637f03345dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:09 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Volume b1f00e38-db5c-4d9b-807e-1888a3f681c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9', 'volume_size': 1} Apr 02 12:38:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:09 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-116562989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1f00e38-db5c-4d9b-807e-1888a3f681c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b002bc55a9da4c5ab9c3e72eaabb0e28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:38:09Z,use_quota=True,user_id='2e6a2495db2f43519cd1349d400ebc6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:38:09 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Creating volume b1f00e38-db5c-4d9b-807e-1888a3f681c9 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:38:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:09 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:38:09 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:38:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:09 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:38:09 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:38:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:09 devstack sudo[86249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9 1073741824 Apr 02 12:38:09 devstack sudo[86249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:09 devstack sudo[86249]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9 1073741824" returned: 0 in 0.664s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:10 devstack sudo[86277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9 Apr 02 12:38:10 devstack sudo[86277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:10 devstack sudo[86277]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9" returned: 0 in 0.464s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:10 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:38:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:10 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fdff5d8-d0e9-49f4-8fb8-c637f03345dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:10 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cbae4b5-c8a4-47d9-b4aa-49697cc91f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:10 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Volume volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9 (b1f00e38-db5c-4d9b-807e-1888a3f681c9): created successfully Apr 02 12:38:10 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cbae4b5-c8a4-47d9-b4aa-49697cc91f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:10 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Flow 'volume_create_manager' (635721e4-ae4c-4db2-8c34-9f9283b2bf43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:38:10 devstack cinder-volume[82819]: INFO cinder.volume.manager [req-14101d57-fcd1-4044-af0f-95014afb7f19 req-452edf2f-7ec1-4dbd-9cf0-2046fdea0092 tempest-VolumesSnapshotsTestJSON-983766857 None] Created volume successfully. Apr 02 12:38:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-8a972bcf-c982-4d3f-a853-3fd03b9c37dc req-05763fc9-851d-4c37-a078-eb8c3b3ae130 tempest-VolumesSnapshotsTestJSON-983766857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-8a972bcf-c982-4d3f-a853-3fd03b9c37dc req-05763fc9-851d-4c37-a078-eb8c3b3ae130 tempest-VolumesSnapshotsTestJSON-983766857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:11 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [req-8a972bcf-c982-4d3f-a853-3fd03b9c37dc req-05763fc9-851d-4c37-a078-eb8c3b3ae130 tempest-VolumesSnapshotsTestJSON-983766857 None] Creating offline snapshot 7258c4e4-b699-4614-808e-07c49425f723 of volume b1f00e38-db5c-4d9b-807e-1888a3f681c9 {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:38:11 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ed6cba-d0aa-40f5-8691-8caa53e17216]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-8a972bcf-c982-4d3f-a853-3fd03b9c37dc req-05763fc9-851d-4c37-a078-eb8c3b3ae130 tempest-VolumesSnapshotsTestJSON-983766857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:11 devstack sudo[86285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9 Apr 02 12:38:11 devstack sudo[86285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:12 devstack sudo[86285]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-8a972bcf-c982-4d3f-a853-3fd03b9c37dc req-05763fc9-851d-4c37-a078-eb8c3b3ae130 tempest-VolumesSnapshotsTestJSON-983766857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9" returned: 0 in 0.739s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-8a972bcf-c982-4d3f-a853-3fd03b9c37dc req-05763fc9-851d-4c37-a078-eb8c3b3ae130 tempest-VolumesSnapshotsTestJSON-983766857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9.7258c4e4-b699-4614-808e-07c49425f723 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:12 devstack sudo[86293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9.7258c4e4-b699-4614-808e-07c49425f723 1G Apr 02 12:38:12 devstack sudo[86293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:13 devstack cinder-volume[82819]: DEBUG oslo_service.periodic_task [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82819) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 12:38:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:38:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:38:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:13 devstack sudo[86298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:38:13 devstack sudo[86298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:13 devstack sudo[86293]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-8a972bcf-c982-4d3f-a853-3fd03b9c37dc req-05763fc9-851d-4c37-a078-eb8c3b3ae130 tempest-VolumesSnapshotsTestJSON-983766857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9.7258c4e4-b699-4614-808e-07c49425f723 1G" returned: 0 in 0.804s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-8a972bcf-c982-4d3f-a853-3fd03b9c37dc req-05763fc9-851d-4c37-a078-eb8c3b3ae130 tempest-VolumesSnapshotsTestJSON-983766857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9.7258c4e4-b699-4614-808e-07c49425f723 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:13 devstack sudo[86300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9.7258c4e4-b699-4614-808e-07c49425f723 Apr 02 12:38:13 devstack sudo[86300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:13 devstack sudo[86298]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.593s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:13 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:38:13 devstack sudo[86300]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-8a972bcf-c982-4d3f-a853-3fd03b9c37dc req-05763fc9-851d-4c37-a078-eb8c3b3ae130 tempest-VolumesSnapshotsTestJSON-983766857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9.7258c4e4-b699-4614-808e-07c49425f723" returned: 0 in 0.738s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:13 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [req-8a972bcf-c982-4d3f-a853-3fd03b9c37dc req-05763fc9-851d-4c37-a078-eb8c3b3ae130 tempest-VolumesSnapshotsTestJSON-983766857 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9.7258c4e4-b699-4614-808e-07c49425f723 is being set with open permissions: ugo+rw Apr 02 12:38:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-8a972bcf-c982-4d3f-a853-3fd03b9c37dc req-05763fc9-851d-4c37-a078-eb8c3b3ae130 tempest-VolumesSnapshotsTestJSON-983766857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9.7258c4e4-b699-4614-808e-07c49425f723 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:14 devstack sudo[86307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9.7258c4e4-b699-4614-808e-07c49425f723 Apr 02 12:38:14 devstack sudo[86307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:14 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:38:14 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Flow 'volume_create_manager' (4f8d45e1-7f33-43bb-9054-fe2b5a3b3ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:38:14 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139652bf-2cba-4223-b814-b23f89e98478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:14 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139652bf-2cba-4223-b814-b23f89e98478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-872026665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c333735e-1e02-4172-927d-5827e0653f86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe12e999811c4ef2abd1a0828078c900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:38:14Z,use_quota=True,user_id='fd18e45f7b884ede82aec0dfce33b8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:14 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (193890a8-5a08-4646-a886-1600b2ad53a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:14 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (193890a8-5a08-4646-a886-1600b2ad53a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:14 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0acd986-79c1-4726-ade4-b2f219c48188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:14 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0acd986-79c1-4726-ade4-b2f219c48188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c333735e-1e02-4172-927d-5827e0653f86', 'volume_name': 'volume-c333735e-1e02-4172-927d-5827e0653f86', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:14 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70467cef-49b2-4110-85e3-46648e27036c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:14 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70467cef-49b2-4110-85e3-46648e27036c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:14 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6461621-8e8b-4198-aea0-ed4872e1f51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:14 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Volume c333735e-1e02-4172-927d-5827e0653f86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c333735e-1e02-4172-927d-5827e0653f86', 'volume_size': 1} Apr 02 12:38:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:14 devstack sudo[86307]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-8a972bcf-c982-4d3f-a853-3fd03b9c37dc req-05763fc9-851d-4c37-a078-eb8c3b3ae130 tempest-VolumesSnapshotsTestJSON-983766857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9.7258c4e4-b699-4614-808e-07c49425f723" returned: 0 in 0.580s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-8a972bcf-c982-4d3f-a853-3fd03b9c37dc req-05763fc9-851d-4c37-a078-eb8c3b3ae130 tempest-VolumesSnapshotsTestJSON-983766857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:14 devstack sudo[86310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9.info Apr 02 12:38:14 devstack sudo[86310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:15 devstack sudo[86310]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-8a972bcf-c982-4d3f-a853-3fd03b9c37dc req-05763fc9-851d-4c37-a078-eb8c3b3ae130 tempest-VolumesSnapshotsTestJSON-983766857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9.info" returned: 0 in 0.606s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:15 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [req-8a972bcf-c982-4d3f-a853-3fd03b9c37dc req-05763fc9-851d-4c37-a078-eb8c3b3ae130 tempest-VolumesSnapshotsTestJSON-983766857 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9.info is being set with open permissions: ugo+rw Apr 02 12:38:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-8a972bcf-c982-4d3f-a853-3fd03b9c37dc req-05763fc9-851d-4c37-a078-eb8c3b3ae130 tempest-VolumesSnapshotsTestJSON-983766857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:15 devstack sudo[86313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9.info Apr 02 12:38:15 devstack sudo[86313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:15 devstack sudo[86313]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-8a972bcf-c982-4d3f-a853-3fd03b9c37dc req-05763fc9-851d-4c37-a078-eb8c3b3ae130 tempest-VolumesSnapshotsTestJSON-983766857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9.info" returned: 0 in 0.622s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-8a972bcf-c982-4d3f-a853-3fd03b9c37dc req-05763fc9-851d-4c37-a078-eb8c3b3ae130 tempest-VolumesSnapshotsTestJSON-983766857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.178s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.459s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:15 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-872026665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c333735e-1e02-4172-927d-5827e0653f86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe12e999811c4ef2abd1a0828078c900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:38:14Z,use_quota=True,user_id='fd18e45f7b884ede82aec0dfce33b8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:38:15 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Creating volume c333735e-1e02-4172-927d-5827e0653f86 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:38:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:15 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:38:15 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:38:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:15 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:38:15 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:38:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:15 devstack sudo[86318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86 1073741824 Apr 02 12:38:15 devstack sudo[86318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:15 devstack cinder-volume[82819]: INFO cinder.volume.manager [req-8a972bcf-c982-4d3f-a853-3fd03b9c37dc req-05763fc9-851d-4c37-a078-eb8c3b3ae130 tempest-VolumesSnapshotsTestJSON-983766857 None] Create snapshot completed successfully Apr 02 12:38:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-723504d3-9ee6-4e1c-a0c7-f9766fb39e6a req-ae5ce51d-7cd8-41b4-8445-45d5d66c0943 tempest-VolumesSnapshotsTestJSON-983766857 None] Acquiring lock "cinder-7258c4e4-b699-4614-808e-07c49425f723-delete_snapshot" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-723504d3-9ee6-4e1c-a0c7-f9766fb39e6a req-ae5ce51d-7cd8-41b4-8445-45d5d66c0943 tempest-VolumesSnapshotsTestJSON-983766857 None] Lock "cinder-7258c4e4-b699-4614-808e-07c49425f723-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-723504d3-9ee6-4e1c-a0c7-f9766fb39e6a req-ae5ce51d-7cd8-41b4-8445-45d5d66c0943 tempest-VolumesSnapshotsTestJSON-983766857 None] Acquiring lock "cinder-quobyte-b1f00e38-db5c-4d9b-807e-1888a3f681c9" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-723504d3-9ee6-4e1c-a0c7-f9766fb39e6a req-ae5ce51d-7cd8-41b4-8445-45d5d66c0943 tempest-VolumesSnapshotsTestJSON-983766857 None] Lock "cinder-quobyte-b1f00e38-db5c-4d9b-807e-1888a3f681c9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-723504d3-9ee6-4e1c-a0c7-f9766fb39e6a req-ae5ce51d-7cd8-41b4-8445-45d5d66c0943 tempest-VolumesSnapshotsTestJSON-983766857 None] Acquiring lock "cinder-quobyte-7258c4e4-b699-4614-808e-07c49425f723" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-723504d3-9ee6-4e1c-a0c7-f9766fb39e6a req-ae5ce51d-7cd8-41b4-8445-45d5d66c0943 tempest-VolumesSnapshotsTestJSON-983766857 None] Lock "cinder-quobyte-7258c4e4-b699-4614-808e-07c49425f723" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:16 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [req-723504d3-9ee6-4e1c-a0c7-f9766fb39e6a req-ae5ce51d-7cd8-41b4-8445-45d5d66c0943 tempest-VolumesSnapshotsTestJSON-983766857 None] Deleting offline snapshot 7258c4e4-b699-4614-808e-07c49425f723 of volume b1f00e38-db5c-4d9b-807e-1888a3f681c9 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:38:16 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [req-723504d3-9ee6-4e1c-a0c7-f9766fb39e6a req-ae5ce51d-7cd8-41b4-8445-45d5d66c0943 tempest-VolumesSnapshotsTestJSON-983766857 None] snapshot_file for this snap is: volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9.7258c4e4-b699-4614-808e-07c49425f723 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:38:16 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[59528b78-9962-4f34-a34a-93d91bb61332]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-723504d3-9ee6-4e1c-a0c7-f9766fb39e6a req-ae5ce51d-7cd8-41b4-8445-45d5d66c0943 tempest-VolumesSnapshotsTestJSON-983766857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9.7258c4e4-b699-4614-808e-07c49425f723 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:16 devstack sudo[86320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9.7258c4e4-b699-4614-808e-07c49425f723 Apr 02 12:38:16 devstack sudo[86320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:16 devstack sudo[86318]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86 1073741824" returned: 0 in 0.778s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:16 devstack sudo[86346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86 Apr 02 12:38:16 devstack sudo[86346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:17 devstack sudo[86320]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-723504d3-9ee6-4e1c-a0c7-f9766fb39e6a req-ae5ce51d-7cd8-41b4-8445-45d5d66c0943 tempest-VolumesSnapshotsTestJSON-983766857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9.7258c4e4-b699-4614-808e-07c49425f723" returned: 0 in 0.822s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:17 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [req-723504d3-9ee6-4e1c-a0c7-f9766fb39e6a req-ae5ce51d-7cd8-41b4-8445-45d5d66c0943 tempest-VolumesSnapshotsTestJSON-983766857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:38:17 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f339e9b6-b0fd-46ec-ada8-602295126238]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-723504d3-9ee6-4e1c-a0c7-f9766fb39e6a req-ae5ce51d-7cd8-41b4-8445-45d5d66c0943 tempest-VolumesSnapshotsTestJSON-983766857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:17 devstack sudo[86353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9 Apr 02 12:38:17 devstack sudo[86353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:17 devstack sudo[86346]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86" returned: 0 in 0.557s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:17 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:38:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6461621-8e8b-4198-aea0-ed4872e1f51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c333735e-1e02-4172-927d-5827e0653f86', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3c068b-e0fe-4e2b-b05e-0e5ad333480d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:17 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Volume volume-c333735e-1e02-4172-927d-5827e0653f86 (c333735e-1e02-4172-927d-5827e0653f86): created successfully Apr 02 12:38:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3c068b-e0fe-4e2b-b05e-0e5ad333480d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Flow 'volume_create_manager' (4f8d45e1-7f33-43bb-9054-fe2b5a3b3ef5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:38:17 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-4dbc5405-1de8-4cc8-9cc3-a2f1b9265f5a tempest-VolumesSnapshotListTestJSON-1331698097 None] Created volume successfully. Apr 02 12:38:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a3c35b86-4115-4e0b-a1ef-61950e264697 tempest-VolumesSnapshotListTestJSON-1331698097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a3c35b86-4115-4e0b-a1ef-61950e264697 tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:17 devstack sudo[86353]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:17 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-a3c35b86-4115-4e0b-a1ef-61950e264697 tempest-VolumesSnapshotListTestJSON-1331698097 None] Creating offline snapshot c964ef91-1ebf-4889-ab76-a93d4977f05b of volume c333735e-1e02-4172-927d-5827e0653f86 {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:38:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-723504d3-9ee6-4e1c-a0c7-f9766fb39e6a req-ae5ce51d-7cd8-41b4-8445-45d5d66c0943 tempest-VolumesSnapshotsTestJSON-983766857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9" returned: 0 in 0.699s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-723504d3-9ee6-4e1c-a0c7-f9766fb39e6a req-ae5ce51d-7cd8-41b4-8445-45d5d66c0943 tempest-VolumesSnapshotsTestJSON-983766857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9.7258c4e4-b699-4614-808e-07c49425f723 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:17 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ba01f8-52b3-495e-ac4f-76f782582b0d]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3c35b86-4115-4e0b-a1ef-61950e264697 tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:17 devstack sudo[86363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9.7258c4e4-b699-4614-808e-07c49425f723 Apr 02 12:38:17 devstack sudo[86363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:17 devstack sudo[86364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86 Apr 02 12:38:17 devstack sudo[86364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:18 devstack sudo[86363]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-723504d3-9ee6-4e1c-a0c7-f9766fb39e6a req-ae5ce51d-7cd8-41b4-8445-45d5d66c0943 tempest-VolumesSnapshotsTestJSON-983766857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9.7258c4e4-b699-4614-808e-07c49425f723" returned: 0 in 0.575s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-723504d3-9ee6-4e1c-a0c7-f9766fb39e6a req-ae5ce51d-7cd8-41b4-8445-45d5d66c0943 tempest-VolumesSnapshotsTestJSON-983766857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9.7258c4e4-b699-4614-808e-07c49425f723 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:18 devstack sudo[86371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9.7258c4e4-b699-4614-808e-07c49425f723 Apr 02 12:38:18 devstack sudo[86371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:18 devstack sudo[86364]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3c35b86-4115-4e0b-a1ef-61950e264697 tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86" returned: 0 in 0.732s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3c35b86-4115-4e0b-a1ef-61950e264697 tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:18 devstack sudo[86376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b 1G Apr 02 12:38:18 devstack sudo[86376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:18 devstack sudo[86371]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-723504d3-9ee6-4e1c-a0c7-f9766fb39e6a req-ae5ce51d-7cd8-41b4-8445-45d5d66c0943 tempest-VolumesSnapshotsTestJSON-983766857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9.7258c4e4-b699-4614-808e-07c49425f723" returned: 0 in 0.533s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-723504d3-9ee6-4e1c-a0c7-f9766fb39e6a req-ae5ce51d-7cd8-41b4-8445-45d5d66c0943 tempest-VolumesSnapshotsTestJSON-983766857 None] Lock "cinder-quobyte-7258c4e4-b699-4614-808e-07c49425f723" released by "_delete_snapshot" :: held 2.735s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-723504d3-9ee6-4e1c-a0c7-f9766fb39e6a req-ae5ce51d-7cd8-41b4-8445-45d5d66c0943 tempest-VolumesSnapshotsTestJSON-983766857 None] Lock "cinder-quobyte-b1f00e38-db5c-4d9b-807e-1888a3f681c9" released by "delete_snapshot" :: held 2.753s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:18 devstack cinder-volume[82819]: DEBUG cinder.quota [req-723504d3-9ee6-4e1c-a0c7-f9766fb39e6a req-ae5ce51d-7cd8-41b4-8445-45d5d66c0943 tempest-VolumesSnapshotsTestJSON-983766857 None] Created reservations ['631b5897-f7c0-47e9-a502-5dc4cb62a631', '9f47bac2-0196-44a3-b3ed-53b492adca96', '4501961c-0e4b-47ae-ae14-81161c268a05', 'd2be66fa-511b-4b03-a30c-00ff6c55b3f7'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:38:19 devstack cinder-volume[82819]: INFO cinder.volume.manager [req-723504d3-9ee6-4e1c-a0c7-f9766fb39e6a req-ae5ce51d-7cd8-41b4-8445-45d5d66c0943 tempest-VolumesSnapshotsTestJSON-983766857 None] Delete snapshot completed successfully. Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-723504d3-9ee6-4e1c-a0c7-f9766fb39e6a req-ae5ce51d-7cd8-41b4-8445-45d5d66c0943 tempest-VolumesSnapshotsTestJSON-983766857 None] Lock "cinder-7258c4e4-b699-4614-808e-07c49425f723-delete_snapshot" released by "delete_snapshot" :: held 2.891s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:19 devstack sudo[86376]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3c35b86-4115-4e0b-a1ef-61950e264697 tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b 1G" returned: 0 in 0.594s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3c35b86-4115-4e0b-a1ef-61950e264697 tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c333735e-1e02-4172-927d-5827e0653f86 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:19 devstack sudo[86383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c333735e-1e02-4172-927d-5827e0653f86 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b Apr 02 12:38:19 devstack sudo[86383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:19 devstack cinder-volume[82819]: INFO cinder.volume.manager [req-53173cde-3e20-4057-9a17-6f7c1849cac9 req-2c9c1ed6-c2d0-425c-b10a-566671d561a7 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Terminate volume connection completed successfully. Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-53173cde-3e20-4057-9a17-6f7c1849cac9 req-2c9c1ed6-c2d0-425c-b10a-566671d561a7 tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Deleting attachment 06d31521-b1df-4a34-9962-a4a85de4e9f8. {{(pid=82819) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Flow 'volume_create_manager' (b5f5fdab-5a00-4ac5-a961-0f97b41b7f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dabedd4-8fe8-4064-9c93-d3d193bd4738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:19 devstack sudo[86383]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dabedd4-8fe8-4064-9c93-d3d193bd4738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1544354802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=721bfad0-85ed-45f4-8d68-a3714b538588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbe6382dfbe4f6fac4033002c3e633b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:38:20Z,use_quota=True,user_id='cfbd105a6b7e47e0b811930fe748e692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0411e359-6b6d-42bd-8bf2-1b2fe5ed1f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0411e359-6b6d-42bd-8bf2-1b2fe5ed1f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dfb4f99-8e2d-4f40-bbef-7141df7f0b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dfb4f99-8e2d-4f40-bbef-7141df7f0b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '721bfad0-85ed-45f4-8d68-a3714b538588', 'volume_name': 'volume-721bfad0-85ed-45f4-8d68-a3714b538588', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d00076-7f3f-487e-8c54-3d6469003279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d00076-7f3f-487e-8c54-3d6469003279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95902a98-ec19-4281-bb86-6ddcfd35bfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:19 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Volume 721bfad0-85ed-45f4-8d68-a3714b538588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-721bfad0-85ed-45f4-8d68-a3714b538588', 'volume_size': 1} Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3c35b86-4115-4e0b-a1ef-61950e264697 tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c333735e-1e02-4172-927d-5827e0653f86 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b" returned: 0 in 0.610s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-4b02ae80-3d52-408f-bb51-eb8ce3e1c8d3 req-a7c56e52-4350-4ecb-8461-2f9df511c131 tempest-VolumesSnapshotsTestJSON-983766857 None] Acquiring lock "cinder-b1f00e38-db5c-4d9b-807e-1888a3f681c9-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:19 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-a3c35b86-4115-4e0b-a1ef-61950e264697 tempest-VolumesSnapshotListTestJSON-1331698097 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b is being set with open permissions: ugo+rw Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3c35b86-4115-4e0b-a1ef-61950e264697 tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-4b02ae80-3d52-408f-bb51-eb8ce3e1c8d3 req-a7c56e52-4350-4ecb-8461-2f9df511c131 tempest-VolumesSnapshotsTestJSON-983766857 None] Lock "cinder-b1f00e38-db5c-4d9b-807e-1888a3f681c9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:19 devstack sudo[86390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b Apr 02 12:38:19 devstack sudo[86390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-4b02ae80-3d52-408f-bb51-eb8ce3e1c8d3 req-a7c56e52-4350-4ecb-8461-2f9df511c131 tempest-VolumesSnapshotsTestJSON-983766857 None] Acquiring lock "cinder-quobyte-b1f00e38-db5c-4d9b-807e-1888a3f681c9" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-4b02ae80-3d52-408f-bb51-eb8ce3e1c8d3 req-a7c56e52-4350-4ecb-8461-2f9df511c131 tempest-VolumesSnapshotsTestJSON-983766857 None] Lock "cinder-quobyte-b1f00e38-db5c-4d9b-807e-1888a3f681c9" acquired by "delete_volume" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c27d98e-2aa3-45a3-90b0-af915b0db343]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-4b02ae80-3d52-408f-bb51-eb8ce3e1c8d3 req-a7c56e52-4350-4ecb-8461-2f9df511c131 tempest-VolumesSnapshotsTestJSON-983766857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-53173cde-3e20-4057-9a17-6f7c1849cac9 req-73273472-2c68-491e-a7e7-681c1b62c99a tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Acquiring lock "cinder-0567e477-2e04-4d12-93a5-5604470b788c-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:19 devstack sudo[86392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9 Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-53173cde-3e20-4057-9a17-6f7c1849cac9 req-73273472-2c68-491e-a7e7-681c1b62c99a tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Lock "cinder-0567e477-2e04-4d12-93a5-5604470b788c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:19 devstack sudo[86392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-53173cde-3e20-4057-9a17-6f7c1849cac9 req-73273472-2c68-491e-a7e7-681c1b62c99a tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Acquiring lock "cinder-quobyte-0567e477-2e04-4d12-93a5-5604470b788c" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-53173cde-3e20-4057-9a17-6f7c1849cac9 req-73273472-2c68-491e-a7e7-681c1b62c99a tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Lock "cinder-quobyte-0567e477-2e04-4d12-93a5-5604470b788c" acquired by "delete_volume" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cb144e-fab2-4cfa-9c0a-c219f7ce5749]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-53173cde-3e20-4057-9a17-6f7c1849cac9 req-73273472-2c68-491e-a7e7-681c1b62c99a tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0567e477-2e04-4d12-93a5-5604470b788c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:20 devstack sudo[86394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0567e477-2e04-4d12-93a5-5604470b788c Apr 02 12:38:20 devstack sudo[86394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:20 devstack sudo[86390]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3c35b86-4115-4e0b-a1ef-61950e264697 tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b" returned: 0 in 0.457s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3c35b86-4115-4e0b-a1ef-61950e264697 tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:20 devstack sudo[86398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.info Apr 02 12:38:20 devstack sudo[86398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:20 devstack sudo[86392]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-4b02ae80-3d52-408f-bb51-eb8ce3e1c8d3 req-a7c56e52-4350-4ecb-8461-2f9df511c131 tempest-VolumesSnapshotsTestJSON-983766857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9" returned: 0 in 0.497s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-4b02ae80-3d52-408f-bb51-eb8ce3e1c8d3 req-a7c56e52-4350-4ecb-8461-2f9df511c131 tempest-VolumesSnapshotsTestJSON-983766857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:20 devstack sudo[86402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9 Apr 02 12:38:20 devstack sudo[86402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:20 devstack sudo[86394]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-53173cde-3e20-4057-9a17-6f7c1849cac9 req-73273472-2c68-491e-a7e7-681c1b62c99a tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0567e477-2e04-4d12-93a5-5604470b788c" returned: 0 in 0.643s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-53173cde-3e20-4057-9a17-6f7c1849cac9 req-73273472-2c68-491e-a7e7-681c1b62c99a tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0567e477-2e04-4d12-93a5-5604470b788c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:20 devstack sudo[86407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0567e477-2e04-4d12-93a5-5604470b788c Apr 02 12:38:20 devstack sudo[86407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:20 devstack sudo[86402]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-4b02ae80-3d52-408f-bb51-eb8ce3e1c8d3 req-a7c56e52-4350-4ecb-8461-2f9df511c131 tempest-VolumesSnapshotsTestJSON-983766857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b1f00e38-db5c-4d9b-807e-1888a3f681c9" returned: 0 in 0.466s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:20 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-4b02ae80-3d52-408f-bb51-eb8ce3e1c8d3 req-a7c56e52-4350-4ecb-8461-2f9df511c131 tempest-VolumesSnapshotsTestJSON-983766857 None] Lock "cinder-quobyte-b1f00e38-db5c-4d9b-807e-1888a3f681c9" released by "delete_volume" :: held 1.007s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:20 devstack sudo[86398]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3c35b86-4115-4e0b-a1ef-61950e264697 tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.info" returned: 0 in 0.617s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:20 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-a3c35b86-4115-4e0b-a1ef-61950e264697 tempest-VolumesSnapshotListTestJSON-1331698097 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.info is being set with open permissions: ugo+rw Apr 02 12:38:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3c35b86-4115-4e0b-a1ef-61950e264697 tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:20 devstack sudo[86411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.info Apr 02 12:38:20 devstack sudo[86411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:20 devstack cinder-volume[82819]: DEBUG cinder.quota [req-4b02ae80-3d52-408f-bb51-eb8ce3e1c8d3 req-a7c56e52-4350-4ecb-8461-2f9df511c131 tempest-VolumesSnapshotsTestJSON-983766857 None] Created reservations ['e53d2d55-d114-4758-8004-c05f1f2b147e', '5be1070b-4aa8-439f-9378-8e84e23f67bb', '7c26560b-5721-4a9f-8381-f797cfccb2b0', 'fa88b475-954f-4acd-89de-6eb07445a823'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:38:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-4b02ae80-3d52-408f-bb51-eb8ce3e1c8d3 req-a7c56e52-4350-4ecb-8461-2f9df511c131 tempest-VolumesSnapshotsTestJSON-983766857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-4b02ae80-3d52-408f-bb51-eb8ce3e1c8d3 req-a7c56e52-4350-4ecb-8461-2f9df511c131 tempest-VolumesSnapshotsTestJSON-983766857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:20 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [req-4b02ae80-3d52-408f-bb51-eb8ce3e1c8d3 req-a7c56e52-4350-4ecb-8461-2f9df511c131 tempest-VolumesSnapshotsTestJSON-983766857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:38:20 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [req-4b02ae80-3d52-408f-bb51-eb8ce3e1c8d3 req-a7c56e52-4350-4ecb-8461-2f9df511c131 tempest-VolumesSnapshotsTestJSON-983766857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:38:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-4b02ae80-3d52-408f-bb51-eb8ce3e1c8d3 req-a7c56e52-4350-4ecb-8461-2f9df511c131 tempest-VolumesSnapshotsTestJSON-983766857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-4b02ae80-3d52-408f-bb51-eb8ce3e1c8d3 req-a7c56e52-4350-4ecb-8461-2f9df511c131 tempest-VolumesSnapshotsTestJSON-983766857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:20 devstack sudo[86413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:38:20 devstack sudo[86413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:21 devstack sudo[86407]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-53173cde-3e20-4057-9a17-6f7c1849cac9 req-73273472-2c68-491e-a7e7-681c1b62c99a tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0567e477-2e04-4d12-93a5-5604470b788c" returned: 0 in 0.497s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-53173cde-3e20-4057-9a17-6f7c1849cac9 req-73273472-2c68-491e-a7e7-681c1b62c99a tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Lock "cinder-quobyte-0567e477-2e04-4d12-93a5-5604470b788c" released by "delete_volume" :: held 1.168s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG cinder.quota [req-53173cde-3e20-4057-9a17-6f7c1849cac9 req-73273472-2c68-491e-a7e7-681c1b62c99a tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Created reservations ['caa2e723-faeb-48ae-803d-4055c76475c2', '4ff37f34-c49f-4002-a2df-b26569479b60', '4f4a6439-0a7a-4e19-ad7d-4568a36e8019', '83172688-6764-42a4-b696-b8635b06d5cf'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-53173cde-3e20-4057-9a17-6f7c1849cac9 req-73273472-2c68-491e-a7e7-681c1b62c99a tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-53173cde-3e20-4057-9a17-6f7c1849cac9 req-73273472-2c68-491e-a7e7-681c1b62c99a tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [req-53173cde-3e20-4057-9a17-6f7c1849cac9 req-73273472-2c68-491e-a7e7-681c1b62c99a tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [req-53173cde-3e20-4057-9a17-6f7c1849cac9 req-73273472-2c68-491e-a7e7-681c1b62c99a tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-53173cde-3e20-4057-9a17-6f7c1849cac9 req-73273472-2c68-491e-a7e7-681c1b62c99a tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-53173cde-3e20-4057-9a17-6f7c1849cac9 req-73273472-2c68-491e-a7e7-681c1b62c99a tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:21 devstack sudo[86417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:38:21 devstack sudo[86417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:21 devstack sudo[86411]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3c35b86-4115-4e0b-a1ef-61950e264697 tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.info" returned: 0 in 0.477s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a3c35b86-4115-4e0b-a1ef-61950e264697 tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.580s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.602s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1544354802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=721bfad0-85ed-45f4-8d68-a3714b538588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbe6382dfbe4f6fac4033002c3e633b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:38:20Z,use_quota=True,user_id='cfbd105a6b7e47e0b811930fe748e692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Creating volume 721bfad0-85ed-45f4-8d68-a3714b538588 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:38:21 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-721bfad0-85ed-45f4-8d68-a3714b538588 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:21 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-a3c35b86-4115-4e0b-a1ef-61950e264697 tempest-VolumesSnapshotListTestJSON-1331698097 None] Create snapshot completed successfully Apr 02 12:38:21 devstack sudo[86420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-721bfad0-85ed-45f4-8d68-a3714b538588 1073741824 Apr 02 12:38:21 devstack sudo[86420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:21 devstack sudo[86413]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-4b02ae80-3d52-408f-bb51-eb8ce3e1c8d3 req-a7c56e52-4350-4ecb-8461-2f9df511c131 tempest-VolumesSnapshotsTestJSON-983766857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.496s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG cinder.manager [req-4b02ae80-3d52-408f-bb51-eb8ce3e1c8d3 req-a7c56e52-4350-4ecb-8461-2f9df511c131 tempest-VolumesSnapshotsTestJSON-983766857 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:38:21 devstack cinder-volume[82819]: INFO cinder.volume.manager [req-4b02ae80-3d52-408f-bb51-eb8ce3e1c8d3 req-a7c56e52-4350-4ecb-8461-2f9df511c131 tempest-VolumesSnapshotsTestJSON-983766857 None] Deleted volume successfully. Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-4b02ae80-3d52-408f-bb51-eb8ce3e1c8d3 req-a7c56e52-4350-4ecb-8461-2f9df511c131 tempest-VolumesSnapshotsTestJSON-983766857 None] Lock "cinder-b1f00e38-db5c-4d9b-807e-1888a3f681c9-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:21 devstack sudo[86417]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-53173cde-3e20-4057-9a17-6f7c1849cac9 req-73273472-2c68-491e-a7e7-681c1b62c99a tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.467s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG cinder.manager [req-53173cde-3e20-4057-9a17-6f7c1849cac9 req-73273472-2c68-491e-a7e7-681c1b62c99a tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:38:21 devstack cinder-volume[82819]: INFO cinder.volume.manager [req-53173cde-3e20-4057-9a17-6f7c1849cac9 req-73273472-2c68-491e-a7e7-681c1b62c99a tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Deleted volume successfully. Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-53173cde-3e20-4057-9a17-6f7c1849cac9 req-73273472-2c68-491e-a7e7-681c1b62c99a tempest-ServerBootFromVolumeStableRescueTest-1114702912 None] Lock "cinder-0567e477-2e04-4d12-93a5-5604470b788c-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:21 devstack sudo[86420]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-721bfad0-85ed-45f4-8d68-a3714b538588 1073741824" returned: 0 in 0.631s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-721bfad0-85ed-45f4-8d68-a3714b538588 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:22 devstack sudo[86426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-721bfad0-85ed-45f4-8d68-a3714b538588 Apr 02 12:38:22 devstack sudo[86426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-875812cd-00da-4c04-aa72-fda880bd7338 tempest-VolumesSnapshotListTestJSON-1331698097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:22 devstack sudo[86426]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-721bfad0-85ed-45f4-8d68-a3714b538588" returned: 0 in 0.488s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:22 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:38:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-875812cd-00da-4c04-aa72-fda880bd7338 tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.397s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95902a98-ec19-4281-bb86-6ddcfd35bfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-721bfad0-85ed-45f4-8d68-a3714b538588', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971c2126-28de-4dd5-a5a9-9e0e1936ac42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:22 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-875812cd-00da-4c04-aa72-fda880bd7338 tempest-VolumesSnapshotListTestJSON-1331698097 None] Creating offline snapshot fb22bce0-1123-4003-bf45-7b48973d3be1 of volume c333735e-1e02-4172-927d-5827e0653f86 {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:38:22 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Volume volume-721bfad0-85ed-45f4-8d68-a3714b538588 (721bfad0-85ed-45f4-8d68-a3714b538588): created successfully Apr 02 12:38:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971c2126-28de-4dd5-a5a9-9e0e1936ac42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Flow 'volume_create_manager' (b5f5fdab-5a00-4ac5-a961-0f97b41b7f6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:38:22 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4e875a-fc67-4ed9-b7a4-2b08581004a4]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-875812cd-00da-4c04-aa72-fda880bd7338 tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:22 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-b9653e0c-37d1-4d2c-a8c4-d4864ec81506 tempest-VolumesListAdminTestJSON-489789897 None] Created volume successfully. Apr 02 12:38:22 devstack sudo[86429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b Apr 02 12:38:22 devstack sudo[86429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:23 devstack sudo[86429]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-875812cd-00da-4c04-aa72-fda880bd7338 tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b" returned: 0 in 0.702s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:23 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-875812cd-00da-4c04-aa72-fda880bd7338 tempest-VolumesSnapshotListTestJSON-1331698097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c333735e-1e02-4172-927d-5827e0653f86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:38:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-875812cd-00da-4c04-aa72-fda880bd7338 tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:23 devstack sudo[86436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1 1G Apr 02 12:38:23 devstack sudo[86436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:23 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:38:23 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Flow 'volume_create_manager' (be037c97-77f5-4695-a89d-402edb49696c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:38:23 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11af5754-2c8c-42b4-b353-49f44e5e2385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:23 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11af5754-2c8c-42b4-b353-49f44e5e2385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1651222328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b05a0f5-74c6-4336-906a-0958348ce447,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbe6382dfbe4f6fac4033002c3e633b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:38:23Z,use_quota=True,user_id='cfbd105a6b7e47e0b811930fe748e692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:23 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f82fe621-532b-4ddb-ba32-dcd3980a800d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:23 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f82fe621-532b-4ddb-ba32-dcd3980a800d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:23 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10179056-d605-40cd-956a-5a8ea3561731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:23 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10179056-d605-40cd-956a-5a8ea3561731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b05a0f5-74c6-4336-906a-0958348ce447', 'volume_name': 'volume-3b05a0f5-74c6-4336-906a-0958348ce447', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:23 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2753613-d33e-4dc5-a537-321fd44d55ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:23 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2753613-d33e-4dc5-a537-321fd44d55ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:23 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf22c2b4-a307-4b49-8438-0e43ea163231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:23 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Volume 3b05a0f5-74c6-4336-906a-0958348ce447: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b05a0f5-74c6-4336-906a-0958348ce447', 'volume_size': 1} Apr 02 12:38:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:23 devstack sudo[86436]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-875812cd-00da-4c04-aa72-fda880bd7338 tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1 1G" returned: 0 in 0.632s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-875812cd-00da-4c04-aa72-fda880bd7338 tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:23 devstack sudo[86441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1 Apr 02 12:38:23 devstack sudo[86441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:24 devstack sudo[86441]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-875812cd-00da-4c04-aa72-fda880bd7338 tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1" returned: 0 in 0.733s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:24 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-875812cd-00da-4c04-aa72-fda880bd7338 tempest-VolumesSnapshotListTestJSON-1331698097 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1 is being set with open permissions: ugo+rw Apr 02 12:38:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-875812cd-00da-4c04-aa72-fda880bd7338 tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:24 devstack sudo[86470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1 Apr 02 12:38:24 devstack sudo[86470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:25 devstack sudo[86470]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-875812cd-00da-4c04-aa72-fda880bd7338 tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1" returned: 0 in 0.647s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-875812cd-00da-4c04-aa72-fda880bd7338 tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.827s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.890s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:25 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1651222328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b05a0f5-74c6-4336-906a-0958348ce447,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbe6382dfbe4f6fac4033002c3e633b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:38:23Z,use_quota=True,user_id='cfbd105a6b7e47e0b811930fe748e692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:38:25 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Creating volume 3b05a0f5-74c6-4336-906a-0958348ce447 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:38:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:25 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:38:25 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:38:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:25 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:38:25 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:38:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3b05a0f5-74c6-4336-906a-0958348ce447 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:25 devstack sudo[86475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3b05a0f5-74c6-4336-906a-0958348ce447 1073741824 Apr 02 12:38:25 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:25 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-875812cd-00da-4c04-aa72-fda880bd7338 tempest-VolumesSnapshotListTestJSON-1331698097 None] Create snapshot completed successfully Apr 02 12:38:25 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:38:25 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Flow 'volume_create_manager' (0500ae7f-5f21-4d0e-88e2-cf113ab92639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:38:25 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7cfaa6f-5dda-412f-9955-8e65084aa0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:25 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7cfaa6f-5dda-412f-9955-8e65084aa0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1348596978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae07a37e-b4a4-4ceb-b382-c6ab5cae8cbc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5177b7b7e03046cda279a798cc91c3f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:38:26Z,use_quota=True,user_id='820351ba6e924d40a446da48949c9f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:25 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71f15944-ce08-47fa-9828-7de3b0c177ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:25 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71f15944-ce08-47fa-9828-7de3b0c177ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:25 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5759cd39-5313-4fa2-bba5-effcdd8b4a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:25 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5759cd39-5313-4fa2-bba5-effcdd8b4a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae07a37e-b4a4-4ceb-b382-c6ab5cae8cbc', 'volume_name': 'volume-ae07a37e-b4a4-4ceb-b382-c6ab5cae8cbc', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:25 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da4e7448-9522-4fbe-af01-24d49727fc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:25 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da4e7448-9522-4fbe-af01-24d49727fc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:25 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef84232-21c4-4d3b-bffe-683787394826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:25 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Volume ae07a37e-b4a4-4ceb-b382-c6ab5cae8cbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae07a37e-b4a4-4ceb-b382-c6ab5cae8cbc', 'volume_size': 1} Apr 02 12:38:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:26 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3b05a0f5-74c6-4336-906a-0958348ce447 1073741824" returned: 0 in 0.784s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3b05a0f5-74c6-4336-906a-0958348ce447 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:26 devstack sudo[86483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3b05a0f5-74c6-4336-906a-0958348ce447 Apr 02 12:38:26 devstack sudo[86483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-263a5f0d-7844-4335-bd21-84c0e495f5cf tempest-VolumesSnapshotListTestJSON-1331698097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:26 devstack sudo[86483]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3b05a0f5-74c6-4336-906a-0958348ce447" returned: 0 in 0.590s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:26 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:38:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.988s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:26 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1348596978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae07a37e-b4a4-4ceb-b382-c6ab5cae8cbc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5177b7b7e03046cda279a798cc91c3f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:38:26Z,use_quota=True,user_id='820351ba6e924d40a446da48949c9f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:38:26 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Creating volume ae07a37e-b4a4-4ceb-b382-c6ab5cae8cbc {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:38:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:26 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:38:26 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:38:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:26 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:38:26 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:38:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ae07a37e-b4a4-4ceb-b382-c6ab5cae8cbc 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:26 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf22c2b4-a307-4b49-8438-0e43ea163231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b05a0f5-74c6-4336-906a-0958348ce447', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:26 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dca6d22b-e7ea-4e9e-aae0-aa10fbdc4bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:26 devstack sudo[86489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ae07a37e-b4a4-4ceb-b382-c6ab5cae8cbc 1073741824 Apr 02 12:38:26 devstack sudo[86489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:26 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Volume volume-3b05a0f5-74c6-4336-906a-0958348ce447 (3b05a0f5-74c6-4336-906a-0958348ce447): created successfully Apr 02 12:38:26 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dca6d22b-e7ea-4e9e-aae0-aa10fbdc4bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:26 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Flow 'volume_create_manager' (be037c97-77f5-4695-a89d-402edb49696c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:38:26 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-d8813c80-0b10-4a04-8e7f-9c811ff8b0b7 tempest-VolumesListAdminTestJSON-489789897 None] Created volume successfully. Apr 02 12:38:27 devstack sudo[86489]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ae07a37e-b4a4-4ceb-b382-c6ab5cae8cbc 1073741824" returned: 0 in 0.543s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ae07a37e-b4a4-4ceb-b382-c6ab5cae8cbc {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:27 devstack sudo[86494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ae07a37e-b4a4-4ceb-b382-c6ab5cae8cbc Apr 02 12:38:27 devstack sudo[86494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:27 devstack sudo[86494]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ae07a37e-b4a4-4ceb-b382-c6ab5cae8cbc" returned: 0 in 0.543s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:27 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:38:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-263a5f0d-7844-4335-bd21-84c0e495f5cf tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.381s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:27 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef84232-21c4-4d3b-bffe-683787394826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae07a37e-b4a4-4ceb-b382-c6ab5cae8cbc', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:27 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b98e5a-8a06-4e04-b293-b943f32810ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:27 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Volume volume-ae07a37e-b4a4-4ceb-b382-c6ab5cae8cbc (ae07a37e-b4a4-4ceb-b382-c6ab5cae8cbc): created successfully Apr 02 12:38:27 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b98e5a-8a06-4e04-b293-b943f32810ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:27 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Flow 'volume_create_manager' (0500ae7f-5f21-4d0e-88e2-cf113ab92639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:38:27 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-263a5f0d-7844-4335-bd21-84c0e495f5cf tempest-VolumesSnapshotListTestJSON-1331698097 None] Creating offline snapshot 026c24af-b270-4732-b520-e706b15dc7b3 of volume c333735e-1e02-4172-927d-5827e0653f86 {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:38:27 devstack cinder-volume[82819]: INFO cinder.volume.manager [req-0a86ec41-53d9-479f-9a9c-ec7c3aba7986 req-b230272a-7aff-4a60-931c-962a695be444 tempest-VolumesGetTestJSON-1279774029 None] Created volume successfully. Apr 02 12:38:27 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df31ca4-49f7-4eb4-9275-952fab8921aa]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-263a5f0d-7844-4335-bd21-84c0e495f5cf tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:27 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:38:27 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Flow 'volume_create_manager' (f8d798f8-251d-4894-805a-0536a2ef3ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:38:27 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ad4d6c-f01d-4ac8-b199-333da52174af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:27 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ad4d6c-f01d-4ac8-b199-333da52174af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-513192366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf973837-c060-4423-9d15-2b158c01e8b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbe6382dfbe4f6fac4033002c3e633b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:38:28Z,use_quota=True,user_id='cfbd105a6b7e47e0b811930fe748e692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41804631-e645-4e7f-90cc-9c185271ecd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41804631-e645-4e7f-90cc-9c185271ecd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b25134b-b55c-410a-b2c8-04bbc275d48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:28 devstack sudo[86498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1 Apr 02 12:38:28 devstack sudo[86498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b25134b-b55c-410a-b2c8-04bbc275d48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf973837-c060-4423-9d15-2b158c01e8b4', 'volume_name': 'volume-bf973837-c060-4423-9d15-2b158c01e8b4', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df4b395-686e-4363-a49d-a381335dc67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df4b395-686e-4363-a49d-a381335dc67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d2bfe9b-3822-46e1-9e69-ca0ae59766d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:28 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Volume bf973837-c060-4423-9d15-2b158c01e8b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf973837-c060-4423-9d15-2b158c01e8b4', 'volume_size': 1} Apr 02 12:38:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:28 devstack sudo[86498]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-263a5f0d-7844-4335-bd21-84c0e495f5cf tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1" returned: 0 in 0.505s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:28 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-263a5f0d-7844-4335-bd21-84c0e495f5cf tempest-VolumesSnapshotListTestJSON-1331698097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c333735e-1e02-4172-927d-5827e0653f86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:38:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-263a5f0d-7844-4335-bd21-84c0e495f5cf tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.026c24af-b270-4732-b520-e706b15dc7b3 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:28 devstack sudo[86503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.026c24af-b270-4732-b520-e706b15dc7b3 1G Apr 02 12:38:28 devstack sudo[86503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:29 devstack sudo[86503]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-263a5f0d-7844-4335-bd21-84c0e495f5cf tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.026c24af-b270-4732-b520-e706b15dc7b3 1G" returned: 0 in 0.566s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-263a5f0d-7844-4335-bd21-84c0e495f5cf tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.026c24af-b270-4732-b520-e706b15dc7b3 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:29 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-ee21603d-3131-4687-ac82-64f20b595fbf req-b31ce630-25c7-4fa4-8cad-080b2d6f729b tempest-VolumesGetTestJSON-1279774029 None] Acquiring lock "cinder-ae07a37e-b4a4-4ceb-b382-c6ab5cae8cbc-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:29 devstack sudo[86509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.026c24af-b270-4732-b520-e706b15dc7b3 Apr 02 12:38:29 devstack sudo[86509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:29 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-ee21603d-3131-4687-ac82-64f20b595fbf req-b31ce630-25c7-4fa4-8cad-080b2d6f729b tempest-VolumesGetTestJSON-1279774029 None] Lock "cinder-ae07a37e-b4a4-4ceb-b382-c6ab5cae8cbc-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:29 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-ee21603d-3131-4687-ac82-64f20b595fbf req-b31ce630-25c7-4fa4-8cad-080b2d6f729b tempest-VolumesGetTestJSON-1279774029 None] Acquiring lock "cinder-quobyte-ae07a37e-b4a4-4ceb-b382-c6ab5cae8cbc" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:29 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-ee21603d-3131-4687-ac82-64f20b595fbf req-b31ce630-25c7-4fa4-8cad-080b2d6f729b tempest-VolumesGetTestJSON-1279774029 None] Lock "cinder-quobyte-ae07a37e-b4a4-4ceb-b382-c6ab5cae8cbc" acquired by "delete_volume" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:29 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[46aaf469-4218-4d2e-b824-5f4be0edf10e]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-ee21603d-3131-4687-ac82-64f20b595fbf req-b31ce630-25c7-4fa4-8cad-080b2d6f729b tempest-VolumesGetTestJSON-1279774029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ae07a37e-b4a4-4ceb-b382-c6ab5cae8cbc {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:29 devstack sudo[86511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ae07a37e-b4a4-4ceb-b382-c6ab5cae8cbc Apr 02 12:38:29 devstack sudo[86511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:29 devstack sudo[86509]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-263a5f0d-7844-4335-bd21-84c0e495f5cf tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.026c24af-b270-4732-b520-e706b15dc7b3" returned: 0 in 0.520s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:29 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-263a5f0d-7844-4335-bd21-84c0e495f5cf tempest-VolumesSnapshotListTestJSON-1331698097 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.026c24af-b270-4732-b520-e706b15dc7b3 is being set with open permissions: ugo+rw Apr 02 12:38:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-263a5f0d-7844-4335-bd21-84c0e495f5cf tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.026c24af-b270-4732-b520-e706b15dc7b3 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:29 devstack sudo[86519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.026c24af-b270-4732-b520-e706b15dc7b3 Apr 02 12:38:29 devstack sudo[86519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:29 devstack sudo[86511]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-ee21603d-3131-4687-ac82-64f20b595fbf req-b31ce630-25c7-4fa4-8cad-080b2d6f729b tempest-VolumesGetTestJSON-1279774029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ae07a37e-b4a4-4ceb-b382-c6ab5cae8cbc" returned: 0 in 0.525s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-ee21603d-3131-4687-ac82-64f20b595fbf req-b31ce630-25c7-4fa4-8cad-080b2d6f729b tempest-VolumesGetTestJSON-1279774029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ae07a37e-b4a4-4ceb-b382-c6ab5cae8cbc {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:29 devstack sudo[86521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ae07a37e-b4a4-4ceb-b382-c6ab5cae8cbc Apr 02 12:38:29 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:29 devstack sudo[86519]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-263a5f0d-7844-4335-bd21-84c0e495f5cf tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.026c24af-b270-4732-b520-e706b15dc7b3" returned: 0 in 0.454s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-263a5f0d-7844-4335-bd21-84c0e495f5cf tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.170s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.995s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:30 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-513192366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf973837-c060-4423-9d15-2b158c01e8b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbe6382dfbe4f6fac4033002c3e633b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:38:28Z,use_quota=True,user_id='cfbd105a6b7e47e0b811930fe748e692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:38:30 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Creating volume bf973837-c060-4423-9d15-2b158c01e8b4 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:38:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:30 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:38:30 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:38:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:30 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:38:30 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:38:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-bf973837-c060-4423-9d15-2b158c01e8b4 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:30 devstack sudo[86525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-bf973837-c060-4423-9d15-2b158c01e8b4 1073741824 Apr 02 12:38:30 devstack sudo[86525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:30 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-263a5f0d-7844-4335-bd21-84c0e495f5cf tempest-VolumesSnapshotListTestJSON-1331698097 None] Create snapshot completed successfully Apr 02 12:38:30 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-ee21603d-3131-4687-ac82-64f20b595fbf req-b31ce630-25c7-4fa4-8cad-080b2d6f729b tempest-VolumesGetTestJSON-1279774029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ae07a37e-b4a4-4ceb-b382-c6ab5cae8cbc" returned: 0 in 0.442s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:30 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-ee21603d-3131-4687-ac82-64f20b595fbf req-b31ce630-25c7-4fa4-8cad-080b2d6f729b tempest-VolumesGetTestJSON-1279774029 None] Lock "cinder-quobyte-ae07a37e-b4a4-4ceb-b382-c6ab5cae8cbc" released by "delete_volume" :: held 0.996s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:30 devstack cinder-volume[82819]: DEBUG cinder.quota [req-ee21603d-3131-4687-ac82-64f20b595fbf req-b31ce630-25c7-4fa4-8cad-080b2d6f729b tempest-VolumesGetTestJSON-1279774029 None] Created reservations ['315898be-f115-4527-bbc0-957e7c14c464', '92f5a04c-1086-4d8c-80f3-2c1f683cf66c', '2bfbf3a0-ccf7-469e-b0fc-18eaa57281ff', '221c861a-8759-4216-aeac-1e7d93a7b3e7'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:38:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-ee21603d-3131-4687-ac82-64f20b595fbf req-b31ce630-25c7-4fa4-8cad-080b2d6f729b tempest-VolumesGetTestJSON-1279774029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-ee21603d-3131-4687-ac82-64f20b595fbf req-b31ce630-25c7-4fa4-8cad-080b2d6f729b tempest-VolumesGetTestJSON-1279774029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:30 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [req-ee21603d-3131-4687-ac82-64f20b595fbf req-b31ce630-25c7-4fa4-8cad-080b2d6f729b tempest-VolumesGetTestJSON-1279774029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:38:30 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [req-ee21603d-3131-4687-ac82-64f20b595fbf req-b31ce630-25c7-4fa4-8cad-080b2d6f729b tempest-VolumesGetTestJSON-1279774029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:38:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [req-ee21603d-3131-4687-ac82-64f20b595fbf req-b31ce630-25c7-4fa4-8cad-080b2d6f729b tempest-VolumesGetTestJSON-1279774029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-ee21603d-3131-4687-ac82-64f20b595fbf req-b31ce630-25c7-4fa4-8cad-080b2d6f729b tempest-VolumesGetTestJSON-1279774029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:30 devstack sudo[86527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:38:30 devstack sudo[86527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:30 devstack sudo[86525]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-bf973837-c060-4423-9d15-2b158c01e8b4 1073741824" returned: 0 in 0.625s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:30 devstack sudo[86527]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [req-ee21603d-3131-4687-ac82-64f20b595fbf req-b31ce630-25c7-4fa4-8cad-080b2d6f729b tempest-VolumesGetTestJSON-1279774029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.504s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:30 devstack cinder-volume[82819]: DEBUG cinder.manager [req-ee21603d-3131-4687-ac82-64f20b595fbf req-b31ce630-25c7-4fa4-8cad-080b2d6f729b tempest-VolumesGetTestJSON-1279774029 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:38:30 devstack cinder-volume[82819]: INFO cinder.volume.manager [req-ee21603d-3131-4687-ac82-64f20b595fbf req-b31ce630-25c7-4fa4-8cad-080b2d6f729b tempest-VolumesGetTestJSON-1279774029 None] Deleted volume successfully. Apr 02 12:38:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-bf973837-c060-4423-9d15-2b158c01e8b4 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:30 devstack cinder-volume[82819]: DEBUG cinder.coordination [req-ee21603d-3131-4687-ac82-64f20b595fbf req-b31ce630-25c7-4fa4-8cad-080b2d6f729b tempest-VolumesGetTestJSON-1279774029 None] Lock "cinder-ae07a37e-b4a4-4ceb-b382-c6ab5cae8cbc-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:30 devstack sudo[86533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-bf973837-c060-4423-9d15-2b158c01e8b4 Apr 02 12:38:30 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:31 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-bf973837-c060-4423-9d15-2b158c01e8b4" returned: 0 in 0.550s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:31 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:38:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:31 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d2bfe9b-3822-46e1-9e69-ca0ae59766d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf973837-c060-4423-9d15-2b158c01e8b4', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:31 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db0ac45-793c-4eb8-a068-b8b171bd6776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:31 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Volume volume-bf973837-c060-4423-9d15-2b158c01e8b4 (bf973837-c060-4423-9d15-2b158c01e8b4): created successfully Apr 02 12:38:31 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db0ac45-793c-4eb8-a068-b8b171bd6776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:31 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Flow 'volume_create_manager' (f8d798f8-251d-4894-805a-0536a2ef3ace) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:38:31 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-2f26f6eb-8a3a-4975-8184-5eee00ed4817 tempest-VolumesListAdminTestJSON-489789897 None] Created volume successfully. Apr 02 12:38:31 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c4725b3d-4415-4b35-bdea-518680fca2b3 tempest-VolumesSnapshotListTestJSON-1331698097 None] Acquiring lock "cinder-026c24af-b270-4732-b520-e706b15dc7b3-delete_snapshot" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:31 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c4725b3d-4415-4b35-bdea-518680fca2b3 tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "cinder-026c24af-b270-4732-b520-e706b15dc7b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:31 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c4725b3d-4415-4b35-bdea-518680fca2b3 tempest-VolumesSnapshotListTestJSON-1331698097 None] Acquiring lock "cinder-quobyte-c333735e-1e02-4172-927d-5827e0653f86" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:31 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c4725b3d-4415-4b35-bdea-518680fca2b3 tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "cinder-quobyte-c333735e-1e02-4172-927d-5827e0653f86" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:31 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c4725b3d-4415-4b35-bdea-518680fca2b3 tempest-VolumesSnapshotListTestJSON-1331698097 None] Acquiring lock "cinder-quobyte-026c24af-b270-4732-b520-e706b15dc7b3" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:31 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c4725b3d-4415-4b35-bdea-518680fca2b3 tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "cinder-quobyte-026c24af-b270-4732-b520-e706b15dc7b3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:31 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-c4725b3d-4415-4b35-bdea-518680fca2b3 tempest-VolumesSnapshotListTestJSON-1331698097 None] Deleting offline snapshot 026c24af-b270-4732-b520-e706b15dc7b3 of volume c333735e-1e02-4172-927d-5827e0653f86 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:38:31 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-c4725b3d-4415-4b35-bdea-518680fca2b3 tempest-VolumesSnapshotListTestJSON-1331698097 None] snapshot_file for this snap is: volume-c333735e-1e02-4172-927d-5827e0653f86.026c24af-b270-4732-b520-e706b15dc7b3 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:38:31 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[4507ff35-3808-483d-8b1d-ff9b2d8008fb]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c4725b3d-4415-4b35-bdea-518680fca2b3 tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.026c24af-b270-4732-b520-e706b15dc7b3 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:31 devstack sudo[86536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.026c24af-b270-4732-b520-e706b15dc7b3 Apr 02 12:38:31 devstack sudo[86536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:32 devstack sudo[86536]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c4725b3d-4415-4b35-bdea-518680fca2b3 tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.026c24af-b270-4732-b520-e706b15dc7b3" returned: 0 in 0.600s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-c4725b3d-4415-4b35-bdea-518680fca2b3 tempest-VolumesSnapshotListTestJSON-1331698097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c333735e-1e02-4172-927d-5827e0653f86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b24b23-540c-4786-ba49-99b0f0a2611e]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c4725b3d-4415-4b35-bdea-518680fca2b3 tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:32 devstack sudo[86542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1 Apr 02 12:38:32 devstack sudo[86542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:32 devstack sudo[86542]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c4725b3d-4415-4b35-bdea-518680fca2b3 tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1" returned: 0 in 0.582s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-c4725b3d-4415-4b35-bdea-518680fca2b3 tempest-VolumesSnapshotListTestJSON-1331698097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c333735e-1e02-4172-927d-5827e0653f86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c4725b3d-4415-4b35-bdea-518680fca2b3 tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.026c24af-b270-4732-b520-e706b15dc7b3 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:32 devstack sudo[86547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.026c24af-b270-4732-b520-e706b15dc7b3 Apr 02 12:38:32 devstack sudo[86547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Flow 'volume_create_manager' (21c56576-7285-4cea-8229-1a394721b6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0380ad22-6739-43d9-9291-1b02df2390a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0380ad22-6739-43d9-9291-1b02df2390a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6e79a88-2e42-4003-aa74-82cc962d0049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dcfa65eb98a437081e2e727c17d0a2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:38:33Z,use_quota=True,user_id='9a834e2ca4e740a783a67d67573db4ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52704f18-f4e1-4b0d-8a9c-f8db768cf7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52704f18-f4e1-4b0d-8a9c-f8db768cf7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b0504cd-ded6-43b5-8150-36e285df334b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b0504cd-ded6-43b5-8150-36e285df334b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6e79a88-2e42-4003-aa74-82cc962d0049', 'volume_name': 'volume-c6e79a88-2e42-4003-aa74-82cc962d0049', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d2011ea-4625-4c10-b8d7-0643e9312fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d2011ea-4625-4c10-b8d7-0643e9312fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b95d5d5c-8cad-4a26-b4f2-3f240aac8c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:32 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Volume c6e79a88-2e42-4003-aa74-82cc962d0049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6e79a88-2e42-4003-aa74-82cc962d0049', 'volume_size': 1} Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6e79a88-2e42-4003-aa74-82cc962d0049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dcfa65eb98a437081e2e727c17d0a2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:38:33Z,use_quota=True,user_id='9a834e2ca4e740a783a67d67573db4ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Creating volume c6e79a88-2e42-4003-aa74-82cc962d0049 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:38:32 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:38:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c6e79a88-2e42-4003-aa74-82cc962d0049 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:33 devstack sudo[86549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c6e79a88-2e42-4003-aa74-82cc962d0049 1073741824 Apr 02 12:38:33 devstack sudo[86549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:33 devstack sudo[86547]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c4725b3d-4415-4b35-bdea-518680fca2b3 tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.026c24af-b270-4732-b520-e706b15dc7b3" returned: 0 in 0.709s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c4725b3d-4415-4b35-bdea-518680fca2b3 tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.026c24af-b270-4732-b520-e706b15dc7b3 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:33 devstack sudo[86554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.026c24af-b270-4732-b520-e706b15dc7b3 Apr 02 12:38:33 devstack sudo[86554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:33 devstack sudo[86549]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c6e79a88-2e42-4003-aa74-82cc962d0049 1073741824" returned: 0 in 0.839s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c6e79a88-2e42-4003-aa74-82cc962d0049 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:33 devstack sudo[86559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c6e79a88-2e42-4003-aa74-82cc962d0049 Apr 02 12:38:33 devstack sudo[86559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:34 devstack sudo[86554]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c4725b3d-4415-4b35-bdea-518680fca2b3 tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.026c24af-b270-4732-b520-e706b15dc7b3" returned: 0 in 0.595s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c4725b3d-4415-4b35-bdea-518680fca2b3 tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "cinder-quobyte-026c24af-b270-4732-b520-e706b15dc7b3" released by "_delete_snapshot" :: held 2.575s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c4725b3d-4415-4b35-bdea-518680fca2b3 tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "cinder-quobyte-c333735e-1e02-4172-927d-5827e0653f86" released by "delete_snapshot" :: held 2.595s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:34 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-c4725b3d-4415-4b35-bdea-518680fca2b3 tempest-VolumesSnapshotListTestJSON-1331698097 None] Created reservations ['68bd97e6-c193-42f5-b443-e3f42af37b1b', 'fb001176-d044-4948-9790-6f237667cbe2', 'ca0f22d9-464d-4599-b5e9-c724a84377f0', '7da5a77e-a140-4a1a-8ee7-a2a6f9828e34'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:38:34 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-c4725b3d-4415-4b35-bdea-518680fca2b3 tempest-VolumesSnapshotListTestJSON-1331698097 None] Delete snapshot completed successfully. Apr 02 12:38:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c4725b3d-4415-4b35-bdea-518680fca2b3 tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "cinder-026c24af-b270-4732-b520-e706b15dc7b3-delete_snapshot" released by "delete_snapshot" :: held 2.702s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:34 devstack sudo[86559]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c6e79a88-2e42-4003-aa74-82cc962d0049" returned: 0 in 0.500s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:38:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b95d5d5c-8cad-4a26-b4f2-3f240aac8c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6e79a88-2e42-4003-aa74-82cc962d0049', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (738663e8-605e-490a-9fd1-e85f751c71ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:34 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Volume volume-c6e79a88-2e42-4003-aa74-82cc962d0049 (c6e79a88-2e42-4003-aa74-82cc962d0049): created successfully Apr 02 12:38:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (738663e8-605e-490a-9fd1-e85f751c71ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Flow 'volume_create_manager' (21c56576-7285-4cea-8229-1a394721b6dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:38:34 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-1c35d8d2-e7d7-40c0-8f83-302195c24499 tempest-VolumesListAdminTestJSON-1888818436 None] Created volume successfully. Apr 02 12:38:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6dfb49c9-17aa-4e05-a0dd-eb97a7b2694c tempest-VolumesSnapshotListTestJSON-1331698097 None] Acquiring lock "cinder-fb22bce0-1123-4003-bf45-7b48973d3be1-delete_snapshot" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6dfb49c9-17aa-4e05-a0dd-eb97a7b2694c tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "cinder-fb22bce0-1123-4003-bf45-7b48973d3be1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6dfb49c9-17aa-4e05-a0dd-eb97a7b2694c tempest-VolumesSnapshotListTestJSON-1331698097 None] Acquiring lock "cinder-quobyte-c333735e-1e02-4172-927d-5827e0653f86" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6dfb49c9-17aa-4e05-a0dd-eb97a7b2694c tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "cinder-quobyte-c333735e-1e02-4172-927d-5827e0653f86" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6dfb49c9-17aa-4e05-a0dd-eb97a7b2694c tempest-VolumesSnapshotListTestJSON-1331698097 None] Acquiring lock "cinder-quobyte-fb22bce0-1123-4003-bf45-7b48973d3be1" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6dfb49c9-17aa-4e05-a0dd-eb97a7b2694c tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "cinder-quobyte-fb22bce0-1123-4003-bf45-7b48973d3be1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-6dfb49c9-17aa-4e05-a0dd-eb97a7b2694c tempest-VolumesSnapshotListTestJSON-1331698097 None] Deleting offline snapshot fb22bce0-1123-4003-bf45-7b48973d3be1 of volume c333735e-1e02-4172-927d-5827e0653f86 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:38:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-6dfb49c9-17aa-4e05-a0dd-eb97a7b2694c tempest-VolumesSnapshotListTestJSON-1331698097 None] snapshot_file for this snap is: volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:38:34 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8126eaf-05d9-4de3-b1c0-cce355d25a33]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6dfb49c9-17aa-4e05-a0dd-eb97a7b2694c tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:34 devstack sudo[86564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1 Apr 02 12:38:34 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:35 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f0776884-e734-47ce-b968-8b3eee60ac6c tempest-VolumesListAdminTestJSON-1888818436 None] Acquiring lock "cinder-c6e79a88-2e42-4003-aa74-82cc962d0049-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:35 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f0776884-e734-47ce-b968-8b3eee60ac6c tempest-VolumesListAdminTestJSON-1888818436 None] Lock "cinder-c6e79a88-2e42-4003-aa74-82cc962d0049-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:35 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f0776884-e734-47ce-b968-8b3eee60ac6c tempest-VolumesListAdminTestJSON-1888818436 None] Acquiring lock "cinder-quobyte-c6e79a88-2e42-4003-aa74-82cc962d0049" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:35 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f0776884-e734-47ce-b968-8b3eee60ac6c tempest-VolumesListAdminTestJSON-1888818436 None] Lock "cinder-quobyte-c6e79a88-2e42-4003-aa74-82cc962d0049" acquired by "delete_volume" :: waited 0.017s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:35 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b2a430-97ba-481d-9a6b-46441782d2ec]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f0776884-e734-47ce-b968-8b3eee60ac6c tempest-VolumesListAdminTestJSON-1888818436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c6e79a88-2e42-4003-aa74-82cc962d0049 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:35 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7bea79ce-b32b-4bf1-8279-844cc17026f7 tempest-VolumesListAdminTestJSON-489789897 None] Acquiring lock "cinder-bf973837-c060-4423-9d15-2b158c01e8b4-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:35 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7bea79ce-b32b-4bf1-8279-844cc17026f7 tempest-VolumesListAdminTestJSON-489789897 None] Lock "cinder-bf973837-c060-4423-9d15-2b158c01e8b4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:35 devstack sudo[86569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c6e79a88-2e42-4003-aa74-82cc962d0049 Apr 02 12:38:35 devstack sudo[86569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:35 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7bea79ce-b32b-4bf1-8279-844cc17026f7 tempest-VolumesListAdminTestJSON-489789897 None] Acquiring lock "cinder-quobyte-bf973837-c060-4423-9d15-2b158c01e8b4" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:35 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7bea79ce-b32b-4bf1-8279-844cc17026f7 tempest-VolumesListAdminTestJSON-489789897 None] Lock "cinder-quobyte-bf973837-c060-4423-9d15-2b158c01e8b4" acquired by "delete_volume" :: waited 0.014s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:35 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[a041b0c9-7784-4d48-a94f-d27f61988a51]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7bea79ce-b32b-4bf1-8279-844cc17026f7 tempest-VolumesListAdminTestJSON-489789897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-bf973837-c060-4423-9d15-2b158c01e8b4 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:35 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6dfb49c9-17aa-4e05-a0dd-eb97a7b2694c tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1" returned: 0 in 0.672s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:35 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-6dfb49c9-17aa-4e05-a0dd-eb97a7b2694c tempest-VolumesSnapshotListTestJSON-1331698097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c333735e-1e02-4172-927d-5827e0653f86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:38:35 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8a73c3-4743-4e41-86cd-57e7176b0072]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6dfb49c9-17aa-4e05-a0dd-eb97a7b2694c tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:35 devstack sudo[86571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-bf973837-c060-4423-9d15-2b158c01e8b4 Apr 02 12:38:35 devstack sudo[86571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:35 devstack sudo[86572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b Apr 02 12:38:35 devstack sudo[86572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:35 devstack sudo[86569]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f0776884-e734-47ce-b968-8b3eee60ac6c tempest-VolumesListAdminTestJSON-1888818436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c6e79a88-2e42-4003-aa74-82cc962d0049" returned: 0 in 0.717s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f0776884-e734-47ce-b968-8b3eee60ac6c tempest-VolumesListAdminTestJSON-1888818436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c6e79a88-2e42-4003-aa74-82cc962d0049 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:36 devstack sudo[86578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c6e79a88-2e42-4003-aa74-82cc962d0049 Apr 02 12:38:36 devstack sudo[86578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:36 devstack sudo[86571]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7bea79ce-b32b-4bf1-8279-844cc17026f7 tempest-VolumesListAdminTestJSON-489789897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-bf973837-c060-4423-9d15-2b158c01e8b4" returned: 0 in 0.676s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7bea79ce-b32b-4bf1-8279-844cc17026f7 tempest-VolumesListAdminTestJSON-489789897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-bf973837-c060-4423-9d15-2b158c01e8b4 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:36 devstack sudo[86586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-bf973837-c060-4423-9d15-2b158c01e8b4 Apr 02 12:38:36 devstack sudo[86586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:36 devstack sudo[86572]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6dfb49c9-17aa-4e05-a0dd-eb97a7b2694c tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b" returned: 0 in 0.806s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:36 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-6dfb49c9-17aa-4e05-a0dd-eb97a7b2694c tempest-VolumesSnapshotListTestJSON-1331698097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c333735e-1e02-4172-927d-5827e0653f86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:38:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6dfb49c9-17aa-4e05-a0dd-eb97a7b2694c tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:36 devstack sudo[86588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1 Apr 02 12:38:36 devstack sudo[86588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:36 devstack sudo[86578]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f0776884-e734-47ce-b968-8b3eee60ac6c tempest-VolumesListAdminTestJSON-1888818436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c6e79a88-2e42-4003-aa74-82cc962d0049" returned: 0 in 0.505s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:36 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f0776884-e734-47ce-b968-8b3eee60ac6c tempest-VolumesListAdminTestJSON-1888818436 None] Lock "cinder-quobyte-c6e79a88-2e42-4003-aa74-82cc962d0049" released by "delete_volume" :: held 1.275s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:36 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-f0776884-e734-47ce-b968-8b3eee60ac6c tempest-VolumesListAdminTestJSON-1888818436 None] Created reservations ['b2e5e595-52f2-4085-99fe-38f82709b1b2', 'ff4737a1-5fc0-4e3a-984c-959ab29d7640', '9660a579-abc7-4e12-9e9a-f61c6d570e8e', 'f577910d-aa46-47d6-9975-8484aa4ca027'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:38:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-f0776884-e734-47ce-b968-8b3eee60ac6c tempest-VolumesListAdminTestJSON-1888818436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-f0776884-e734-47ce-b968-8b3eee60ac6c tempest-VolumesListAdminTestJSON-1888818436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:36 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-f0776884-e734-47ce-b968-8b3eee60ac6c tempest-VolumesListAdminTestJSON-1888818436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:38:36 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-f0776884-e734-47ce-b968-8b3eee60ac6c tempest-VolumesListAdminTestJSON-1888818436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:38:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-f0776884-e734-47ce-b968-8b3eee60ac6c tempest-VolumesListAdminTestJSON-1888818436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f0776884-e734-47ce-b968-8b3eee60ac6c tempest-VolumesListAdminTestJSON-1888818436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:36 devstack sudo[86592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:38:36 devstack sudo[86592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:36 devstack sudo[86586]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7bea79ce-b32b-4bf1-8279-844cc17026f7 tempest-VolumesListAdminTestJSON-489789897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-bf973837-c060-4423-9d15-2b158c01e8b4" returned: 0 in 0.559s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:36 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7bea79ce-b32b-4bf1-8279-844cc17026f7 tempest-VolumesListAdminTestJSON-489789897 None] Lock "cinder-quobyte-bf973837-c060-4423-9d15-2b158c01e8b4" released by "delete_volume" :: held 1.269s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:36 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-7bea79ce-b32b-4bf1-8279-844cc17026f7 tempest-VolumesListAdminTestJSON-489789897 None] Created reservations ['7f8e5632-8f0f-481d-a972-8f1d641ae65a', '0321f3c1-c747-4ec2-9cba-792161eebc21', '8214be94-378a-4cdd-a0e6-42e3d578ca8a', '9669ab49-8cbb-4155-b3ff-c6e3f2bbdb94'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:38:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7bea79ce-b32b-4bf1-8279-844cc17026f7 tempest-VolumesListAdminTestJSON-489789897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7bea79ce-b32b-4bf1-8279-844cc17026f7 tempest-VolumesListAdminTestJSON-489789897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:36 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7bea79ce-b32b-4bf1-8279-844cc17026f7 tempest-VolumesListAdminTestJSON-489789897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:38:36 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7bea79ce-b32b-4bf1-8279-844cc17026f7 tempest-VolumesListAdminTestJSON-489789897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:38:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7bea79ce-b32b-4bf1-8279-844cc17026f7 tempest-VolumesListAdminTestJSON-489789897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7bea79ce-b32b-4bf1-8279-844cc17026f7 tempest-VolumesListAdminTestJSON-489789897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:36 devstack sudo[86597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:38:36 devstack sudo[86597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:36 devstack sudo[86588]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6dfb49c9-17aa-4e05-a0dd-eb97a7b2694c tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1" returned: 0 in 0.667s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6dfb49c9-17aa-4e05-a0dd-eb97a7b2694c tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:37 devstack sudo[86599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1 Apr 02 12:38:37 devstack sudo[86599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:37 devstack sudo[86592]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f0776884-e734-47ce-b968-8b3eee60ac6c tempest-VolumesListAdminTestJSON-1888818436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.488s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:37 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-f0776884-e734-47ce-b968-8b3eee60ac6c tempest-VolumesListAdminTestJSON-1888818436 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:38:37 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-f0776884-e734-47ce-b968-8b3eee60ac6c tempest-VolumesListAdminTestJSON-1888818436 None] Deleted volume successfully. Apr 02 12:38:37 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f0776884-e734-47ce-b968-8b3eee60ac6c tempest-VolumesListAdminTestJSON-1888818436 None] Lock "cinder-c6e79a88-2e42-4003-aa74-82cc962d0049-delete_volume" released by "delete_volume" :: held 1.976s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:37 devstack sudo[86597]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7bea79ce-b32b-4bf1-8279-844cc17026f7 tempest-VolumesListAdminTestJSON-489789897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.657s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:37 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-7bea79ce-b32b-4bf1-8279-844cc17026f7 tempest-VolumesListAdminTestJSON-489789897 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:38:37 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-7bea79ce-b32b-4bf1-8279-844cc17026f7 tempest-VolumesListAdminTestJSON-489789897 None] Deleted volume successfully. Apr 02 12:38:37 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7bea79ce-b32b-4bf1-8279-844cc17026f7 tempest-VolumesListAdminTestJSON-489789897 None] Lock "cinder-bf973837-c060-4423-9d15-2b158c01e8b4-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:37 devstack sudo[86599]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6dfb49c9-17aa-4e05-a0dd-eb97a7b2694c tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.fb22bce0-1123-4003-bf45-7b48973d3be1" returned: 0 in 0.628s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:37 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6dfb49c9-17aa-4e05-a0dd-eb97a7b2694c tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "cinder-quobyte-fb22bce0-1123-4003-bf45-7b48973d3be1" released by "_delete_snapshot" :: held 2.851s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:37 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6dfb49c9-17aa-4e05-a0dd-eb97a7b2694c tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "cinder-quobyte-c333735e-1e02-4172-927d-5827e0653f86" released by "delete_snapshot" :: held 2.874s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:37 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-6dfb49c9-17aa-4e05-a0dd-eb97a7b2694c tempest-VolumesSnapshotListTestJSON-1331698097 None] Created reservations ['b2b50369-0e86-46b3-8957-04df8e7b2fd1', '74909c51-a88a-4835-93b2-07ce0b30015c', '6b60dd83-8040-4dfc-9708-1f06222a2685', 'd98d35d8-9288-43b0-97e0-deee64017c87'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:38:37 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-386a1b5c-b5a0-4f5d-a88b-914628f2bc38 tempest-VolumesListAdminTestJSON-489789897 None] Acquiring lock "cinder-3b05a0f5-74c6-4336-906a-0958348ce447-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:37 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-386a1b5c-b5a0-4f5d-a88b-914628f2bc38 tempest-VolumesListAdminTestJSON-489789897 None] Lock "cinder-3b05a0f5-74c6-4336-906a-0958348ce447-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:37 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-6dfb49c9-17aa-4e05-a0dd-eb97a7b2694c tempest-VolumesSnapshotListTestJSON-1331698097 None] Delete snapshot completed successfully. Apr 02 12:38:37 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6dfb49c9-17aa-4e05-a0dd-eb97a7b2694c tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "cinder-fb22bce0-1123-4003-bf45-7b48973d3be1-delete_snapshot" released by "delete_snapshot" :: held 3.261s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:37 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-386a1b5c-b5a0-4f5d-a88b-914628f2bc38 tempest-VolumesListAdminTestJSON-489789897 None] Acquiring lock "cinder-quobyte-3b05a0f5-74c6-4336-906a-0958348ce447" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:38 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-386a1b5c-b5a0-4f5d-a88b-914628f2bc38 tempest-VolumesListAdminTestJSON-489789897 None] Lock "cinder-quobyte-3b05a0f5-74c6-4336-906a-0958348ce447" acquired by "delete_volume" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:38 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[90860150-3f67-498d-ba7c-62b2d9e8b3f1]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-386a1b5c-b5a0-4f5d-a88b-914628f2bc38 tempest-VolumesListAdminTestJSON-489789897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3b05a0f5-74c6-4336-906a-0958348ce447 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:38 devstack sudo[86605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3b05a0f5-74c6-4336-906a-0958348ce447 Apr 02 12:38:38 devstack sudo[86605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:38 devstack sudo[86605]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-386a1b5c-b5a0-4f5d-a88b-914628f2bc38 tempest-VolumesListAdminTestJSON-489789897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3b05a0f5-74c6-4336-906a-0958348ce447" returned: 0 in 0.580s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-386a1b5c-b5a0-4f5d-a88b-914628f2bc38 tempest-VolumesListAdminTestJSON-489789897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3b05a0f5-74c6-4336-906a-0958348ce447 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:38 devstack sudo[86610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3b05a0f5-74c6-4336-906a-0958348ce447 Apr 02 12:38:38 devstack sudo[86610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:38 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-93787a97-7b28-4c4b-8ec0-6cd0059797f5 tempest-VolumesSnapshotListTestJSON-1331698097 None] Acquiring lock "cinder-c964ef91-1ebf-4889-ab76-a93d4977f05b-delete_snapshot" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:38 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-93787a97-7b28-4c4b-8ec0-6cd0059797f5 tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "cinder-c964ef91-1ebf-4889-ab76-a93d4977f05b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:38 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-93787a97-7b28-4c4b-8ec0-6cd0059797f5 tempest-VolumesSnapshotListTestJSON-1331698097 None] Acquiring lock "cinder-quobyte-c333735e-1e02-4172-927d-5827e0653f86" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:38 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-93787a97-7b28-4c4b-8ec0-6cd0059797f5 tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "cinder-quobyte-c333735e-1e02-4172-927d-5827e0653f86" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:38 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-93787a97-7b28-4c4b-8ec0-6cd0059797f5 tempest-VolumesSnapshotListTestJSON-1331698097 None] Acquiring lock "cinder-quobyte-c964ef91-1ebf-4889-ab76-a93d4977f05b" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:39 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-93787a97-7b28-4c4b-8ec0-6cd0059797f5 tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "cinder-quobyte-c964ef91-1ebf-4889-ab76-a93d4977f05b" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:39 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-93787a97-7b28-4c4b-8ec0-6cd0059797f5 tempest-VolumesSnapshotListTestJSON-1331698097 None] Deleting offline snapshot c964ef91-1ebf-4889-ab76-a93d4977f05b of volume c333735e-1e02-4172-927d-5827e0653f86 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:38:39 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-93787a97-7b28-4c4b-8ec0-6cd0059797f5 tempest-VolumesSnapshotListTestJSON-1331698097 None] snapshot_file for this snap is: volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:38:39 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6d3b3e-c202-4864-84e2-f8d3670beb96]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-93787a97-7b28-4c4b-8ec0-6cd0059797f5 tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:39 devstack sudo[86610]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-386a1b5c-b5a0-4f5d-a88b-914628f2bc38 tempest-VolumesListAdminTestJSON-489789897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3b05a0f5-74c6-4336-906a-0958348ce447" returned: 0 in 0.507s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:39 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-386a1b5c-b5a0-4f5d-a88b-914628f2bc38 tempest-VolumesListAdminTestJSON-489789897 None] Lock "cinder-quobyte-3b05a0f5-74c6-4336-906a-0958348ce447" released by "delete_volume" :: held 1.122s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:39 devstack sudo[86613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b Apr 02 12:38:39 devstack sudo[86613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:39 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-386a1b5c-b5a0-4f5d-a88b-914628f2bc38 tempest-VolumesListAdminTestJSON-489789897 None] Created reservations ['e04054dc-a973-4d09-9290-20708e97dbae', 'b238b78c-4831-4bc7-898f-6ca78ca01501', '41da7074-8295-49a4-b6ac-5112d7d38e38', 'ee28f14f-b696-4a39-882e-ee48f0d63c7a'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:38:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-386a1b5c-b5a0-4f5d-a88b-914628f2bc38 tempest-VolumesListAdminTestJSON-489789897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-386a1b5c-b5a0-4f5d-a88b-914628f2bc38 tempest-VolumesListAdminTestJSON-489789897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:39 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-386a1b5c-b5a0-4f5d-a88b-914628f2bc38 tempest-VolumesListAdminTestJSON-489789897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:38:39 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-386a1b5c-b5a0-4f5d-a88b-914628f2bc38 tempest-VolumesListAdminTestJSON-489789897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:38:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-386a1b5c-b5a0-4f5d-a88b-914628f2bc38 tempest-VolumesListAdminTestJSON-489789897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-386a1b5c-b5a0-4f5d-a88b-914628f2bc38 tempest-VolumesListAdminTestJSON-489789897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:39 devstack sudo[86615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:38:39 devstack sudo[86615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:39 devstack sudo[86615]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-386a1b5c-b5a0-4f5d-a88b-914628f2bc38 tempest-VolumesListAdminTestJSON-489789897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.560s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:39 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-386a1b5c-b5a0-4f5d-a88b-914628f2bc38 tempest-VolumesListAdminTestJSON-489789897 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:38:39 devstack sudo[86613]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:39 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-386a1b5c-b5a0-4f5d-a88b-914628f2bc38 tempest-VolumesListAdminTestJSON-489789897 None] Deleted volume successfully. Apr 02 12:38:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-93787a97-7b28-4c4b-8ec0-6cd0059797f5 tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b" returned: 0 in 0.824s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:39 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-93787a97-7b28-4c4b-8ec0-6cd0059797f5 tempest-VolumesSnapshotListTestJSON-1331698097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c333735e-1e02-4172-927d-5827e0653f86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:38:39 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[3916f3ca-1bbe-476c-be56-fafc3441e074]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-93787a97-7b28-4c4b-8ec0-6cd0059797f5 tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:39 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-386a1b5c-b5a0-4f5d-a88b-914628f2bc38 tempest-VolumesListAdminTestJSON-489789897 None] Lock "cinder-3b05a0f5-74c6-4336-906a-0958348ce447-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:39 devstack sudo[86621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86 Apr 02 12:38:39 devstack sudo[86621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:40 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-28334d3e-8999-4c8d-a7de-ed5fb274094a tempest-VolumesListAdminTestJSON-489789897 None] Acquiring lock "cinder-721bfad0-85ed-45f4-8d68-a3714b538588-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:40 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-28334d3e-8999-4c8d-a7de-ed5fb274094a tempest-VolumesListAdminTestJSON-489789897 None] Lock "cinder-721bfad0-85ed-45f4-8d68-a3714b538588-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:40 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-28334d3e-8999-4c8d-a7de-ed5fb274094a tempest-VolumesListAdminTestJSON-489789897 None] Acquiring lock "cinder-quobyte-721bfad0-85ed-45f4-8d68-a3714b538588" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:40 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-28334d3e-8999-4c8d-a7de-ed5fb274094a tempest-VolumesListAdminTestJSON-489789897 None] Lock "cinder-quobyte-721bfad0-85ed-45f4-8d68-a3714b538588" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:40 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd32eae-fee3-4a3a-9941-6085e129e2c6]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-28334d3e-8999-4c8d-a7de-ed5fb274094a tempest-VolumesListAdminTestJSON-489789897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-721bfad0-85ed-45f4-8d68-a3714b538588 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:40 devstack sudo[86623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-721bfad0-85ed-45f4-8d68-a3714b538588 Apr 02 12:38:40 devstack sudo[86623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:40 devstack sudo[86621]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-93787a97-7b28-4c4b-8ec0-6cd0059797f5 tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86" returned: 0 in 0.823s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-93787a97-7b28-4c4b-8ec0-6cd0059797f5 tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:40 devstack sudo[86628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b Apr 02 12:38:40 devstack sudo[86628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:40 devstack sudo[86623]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-28334d3e-8999-4c8d-a7de-ed5fb274094a tempest-VolumesListAdminTestJSON-489789897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-721bfad0-85ed-45f4-8d68-a3714b538588" returned: 0 in 0.704s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-28334d3e-8999-4c8d-a7de-ed5fb274094a tempest-VolumesListAdminTestJSON-489789897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-721bfad0-85ed-45f4-8d68-a3714b538588 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:40 devstack sudo[86633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-721bfad0-85ed-45f4-8d68-a3714b538588 Apr 02 12:38:40 devstack sudo[86633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:41 devstack sudo[86628]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-93787a97-7b28-4c4b-8ec0-6cd0059797f5 tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b" returned: 0 in 0.578s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-93787a97-7b28-4c4b-8ec0-6cd0059797f5 tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:41 devstack sudo[86638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b Apr 02 12:38:41 devstack sudo[86638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:41 devstack sudo[86633]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-28334d3e-8999-4c8d-a7de-ed5fb274094a tempest-VolumesListAdminTestJSON-489789897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-721bfad0-85ed-45f4-8d68-a3714b538588" returned: 0 in 0.663s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:41 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-28334d3e-8999-4c8d-a7de-ed5fb274094a tempest-VolumesListAdminTestJSON-489789897 None] Lock "cinder-quobyte-721bfad0-85ed-45f4-8d68-a3714b538588" released by "delete_volume" :: held 1.423s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:41 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-28334d3e-8999-4c8d-a7de-ed5fb274094a tempest-VolumesListAdminTestJSON-489789897 None] Created reservations ['5fd36f9e-2d99-4616-8237-d7f66df21bef', '4c4a542a-2d9f-4548-bdd3-b8b86f46da66', 'de0362e5-ff43-410e-a339-5ef071d752a0', '827b49e0-744f-4a85-898f-a307803bda18'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:38:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-28334d3e-8999-4c8d-a7de-ed5fb274094a tempest-VolumesListAdminTestJSON-489789897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-28334d3e-8999-4c8d-a7de-ed5fb274094a tempest-VolumesListAdminTestJSON-489789897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:41 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-28334d3e-8999-4c8d-a7de-ed5fb274094a tempest-VolumesListAdminTestJSON-489789897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:38:41 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-28334d3e-8999-4c8d-a7de-ed5fb274094a tempest-VolumesListAdminTestJSON-489789897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:38:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-28334d3e-8999-4c8d-a7de-ed5fb274094a tempest-VolumesListAdminTestJSON-489789897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-28334d3e-8999-4c8d-a7de-ed5fb274094a tempest-VolumesListAdminTestJSON-489789897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:41 devstack sudo[86647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:38:41 devstack sudo[86647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:42 devstack sudo[86638]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-93787a97-7b28-4c4b-8ec0-6cd0059797f5 tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86.c964ef91-1ebf-4889-ab76-a93d4977f05b" returned: 0 in 0.745s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:42 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-93787a97-7b28-4c4b-8ec0-6cd0059797f5 tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "cinder-quobyte-c964ef91-1ebf-4889-ab76-a93d4977f05b" released by "_delete_snapshot" :: held 3.042s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:42 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-93787a97-7b28-4c4b-8ec0-6cd0059797f5 tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "cinder-quobyte-c333735e-1e02-4172-927d-5827e0653f86" released by "delete_snapshot" :: held 3.091s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:42 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-93787a97-7b28-4c4b-8ec0-6cd0059797f5 tempest-VolumesSnapshotListTestJSON-1331698097 None] Created reservations ['4f9e318a-3725-4e1f-baa2-908708b20de3', '2f5147af-8e4b-4685-b457-6cd631a67e1d', '92d4172d-6d70-4239-b5c2-ae2e283c63ad', 'b97a10f5-9733-4cff-beda-c6c445625053'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:38:42 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-93787a97-7b28-4c4b-8ec0-6cd0059797f5 tempest-VolumesSnapshotListTestJSON-1331698097 None] Delete snapshot completed successfully. Apr 02 12:38:42 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-93787a97-7b28-4c4b-8ec0-6cd0059797f5 tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "cinder-c964ef91-1ebf-4889-ab76-a93d4977f05b-delete_snapshot" released by "delete_snapshot" :: held 3.467s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:42 devstack sudo[86647]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-28334d3e-8999-4c8d-a7de-ed5fb274094a tempest-VolumesListAdminTestJSON-489789897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.811s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:42 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-28334d3e-8999-4c8d-a7de-ed5fb274094a tempest-VolumesListAdminTestJSON-489789897 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:38:42 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-28334d3e-8999-4c8d-a7de-ed5fb274094a tempest-VolumesListAdminTestJSON-489789897 None] Deleted volume successfully. Apr 02 12:38:42 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-28334d3e-8999-4c8d-a7de-ed5fb274094a tempest-VolumesListAdminTestJSON-489789897 None] Lock "cinder-721bfad0-85ed-45f4-8d68-a3714b538588-delete_volume" released by "delete_volume" :: held 2.430s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:43 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-031f1ec4-ea8a-4370-8ac9-2258b4673058 tempest-VolumesSnapshotListTestJSON-1331698097 None] Acquiring lock "cinder-c333735e-1e02-4172-927d-5827e0653f86-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:43 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-031f1ec4-ea8a-4370-8ac9-2258b4673058 tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "cinder-c333735e-1e02-4172-927d-5827e0653f86-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:43 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-031f1ec4-ea8a-4370-8ac9-2258b4673058 tempest-VolumesSnapshotListTestJSON-1331698097 None] Acquiring lock "cinder-quobyte-c333735e-1e02-4172-927d-5827e0653f86" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:43 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-031f1ec4-ea8a-4370-8ac9-2258b4673058 tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "cinder-quobyte-c333735e-1e02-4172-927d-5827e0653f86" acquired by "delete_volume" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:43 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[601e99fa-ccc3-48cf-8fc1-95f8802effde]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-031f1ec4-ea8a-4370-8ac9-2258b4673058 tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:43 devstack sudo[86651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86 Apr 02 12:38:43 devstack sudo[86651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:43 devstack sudo[86651]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-031f1ec4-ea8a-4370-8ac9-2258b4673058 tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86" returned: 0 in 0.559s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-031f1ec4-ea8a-4370-8ac9-2258b4673058 tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:43 devstack sudo[86656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86 Apr 02 12:38:43 devstack sudo[86656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:44 devstack sudo[86656]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-031f1ec4-ea8a-4370-8ac9-2258b4673058 tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c333735e-1e02-4172-927d-5827e0653f86" returned: 0 in 0.573s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-031f1ec4-ea8a-4370-8ac9-2258b4673058 tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "cinder-quobyte-c333735e-1e02-4172-927d-5827e0653f86" released by "delete_volume" :: held 1.178s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:44 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-031f1ec4-ea8a-4370-8ac9-2258b4673058 tempest-VolumesSnapshotListTestJSON-1331698097 None] Created reservations ['9bae9c42-0d22-4a3f-b020-c65ead013f1d', '819d013c-104c-4876-85de-84910d43a122', 'd4e20df1-47fd-4c66-9ef5-20a2e05400a4', '1f460bd6-5f85-453c-bd23-1f62e5bf7aa5'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:38:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-031f1ec4-ea8a-4370-8ac9-2258b4673058 tempest-VolumesSnapshotListTestJSON-1331698097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-031f1ec4-ea8a-4370-8ac9-2258b4673058 tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:44 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-031f1ec4-ea8a-4370-8ac9-2258b4673058 tempest-VolumesSnapshotListTestJSON-1331698097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:38:44 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-031f1ec4-ea8a-4370-8ac9-2258b4673058 tempest-VolumesSnapshotListTestJSON-1331698097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:38:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-031f1ec4-ea8a-4370-8ac9-2258b4673058 tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-031f1ec4-ea8a-4370-8ac9-2258b4673058 tempest-VolumesSnapshotListTestJSON-1331698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:44 devstack sudo[86659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:38:44 devstack sudo[86659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:45 devstack sudo[86659]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-031f1ec4-ea8a-4370-8ac9-2258b4673058 tempest-VolumesSnapshotListTestJSON-1331698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.618s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:45 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-031f1ec4-ea8a-4370-8ac9-2258b4673058 tempest-VolumesSnapshotListTestJSON-1331698097 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:38:45 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-031f1ec4-ea8a-4370-8ac9-2258b4673058 tempest-VolumesSnapshotListTestJSON-1331698097 None] Deleted volume successfully. Apr 02 12:38:45 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-031f1ec4-ea8a-4370-8ac9-2258b4673058 tempest-VolumesSnapshotListTestJSON-1331698097 None] Lock "cinder-c333735e-1e02-4172-927d-5827e0653f86-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Flow 'volume_create_manager' (2c9f72c3-1ba3-4465-9b95-978ef38331d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (196d2fcd-7114-4629-9eb8-86802ab676e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (196d2fcd-7114-4629-9eb8-86802ab676e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-739246405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b58e80-1379-4348-a7d8-c5d4de736214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08eb3e7c771f4369971d68907a6cb7de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:38:49Z,use_quota=True,user_id='e0cf56cf7cc2442999b9fda90b8ec197',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d828f0-d557-4933-a0ad-944e6d09bff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d828f0-d557-4933-a0ad-944e6d09bff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fceb57-e4d7-43fd-8902-caff02acb2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fceb57-e4d7-43fd-8902-caff02acb2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47b58e80-1379-4348-a7d8-c5d4de736214', 'volume_name': 'volume-47b58e80-1379-4348-a7d8-c5d4de736214', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2116bb8a-71b9-4316-8d89-5f9e90f159e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2116bb8a-71b9-4316-8d89-5f9e90f159e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ff4c25-ad65-4cc7-b0e8-9426160d1406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:48 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Volume 47b58e80-1379-4348-a7d8-c5d4de736214: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47b58e80-1379-4348-a7d8-c5d4de736214', 'volume_size': 1} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-739246405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b58e80-1379-4348-a7d8-c5d4de736214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08eb3e7c771f4369971d68907a6cb7de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:38:49Z,use_quota=True,user_id='e0cf56cf7cc2442999b9fda90b8ec197',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Creating volume 47b58e80-1379-4348-a7d8-c5d4de736214 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:38:48 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-47b58e80-1379-4348-a7d8-c5d4de736214 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:38:48 devstack sudo[86673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-47b58e80-1379-4348-a7d8-c5d4de736214 1073741824 Apr 02 12:38:48 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Flow 'volume_create_manager' (d0ae33dd-340b-4af1-bce1-93721a7e6b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21fabf42-ac3d-40ae-8646-f5344866fabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21fabf42-ac3d-40ae-8646-f5344866fabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1610216989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9f0c72d6d864c8cb7b39bbd9bf00c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:38:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:38:49Z,use_quota=True,user_id='cc2de48f242f432db6646823b5078280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df486523-47f1-48dd-a2aa-f2c73c45891d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df486523-47f1-48dd-a2aa-f2c73c45891d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b8ab1b6-ba79-40c5-b10f-66043509bc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b8ab1b6-ba79-40c5-b10f-66043509bc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a', 'volume_name': 'volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a', 'volume_size': 2}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (846e0d2e-2521-442f-a52b-859a48b41a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (846e0d2e-2521-442f-a52b-859a48b41a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b85a81-4e30-4094-b631-6f2e8b827b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:48 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Volume eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a', 'volume_size': 2} Apr 02 12:38:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:49 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-47b58e80-1379-4348-a7d8-c5d4de736214 1073741824" returned: 0 in 0.584s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-47b58e80-1379-4348-a7d8-c5d4de736214 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:49 devstack sudo[86678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-47b58e80-1379-4348-a7d8-c5d4de736214 Apr 02 12:38:49 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:49 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-47b58e80-1379-4348-a7d8-c5d4de736214" returned: 0 in 0.466s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:49 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:38:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.998s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:49 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1610216989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9f0c72d6d864c8cb7b39bbd9bf00c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:38:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:38:49Z,use_quota=True,user_id='cc2de48f242f432db6646823b5078280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:38:49 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Creating volume eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:38:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:49 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:38:49 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:38:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:49 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:38:49 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:38:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a 2147483648 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:50 devstack sudo[86681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a 2147483648 Apr 02 12:38:50 devstack sudo[86681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ff4c25-ad65-4cc7-b0e8-9426160d1406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47b58e80-1379-4348-a7d8-c5d4de736214', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfbfb2ec-504f-43d9-9a3a-4347f25f3240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:50 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Volume volume-47b58e80-1379-4348-a7d8-c5d4de736214 (47b58e80-1379-4348-a7d8-c5d4de736214): created successfully Apr 02 12:38:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfbfb2ec-504f-43d9-9a3a-4347f25f3240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Flow 'volume_create_manager' (2c9f72c3-1ba3-4465-9b95-978ef38331d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:38:50 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-a447a586-e33c-498c-96b0-793aa739f4ff tempest-VolumesServicesTestJSON-816395301 None] Created volume successfully. Apr 02 12:38:50 devstack sudo[86681]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a 2147483648" returned: 0 in 0.692s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:50 devstack sudo[86686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a Apr 02 12:38:50 devstack sudo[86686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:51 devstack sudo[86686]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a" returned: 0 in 0.683s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] <== create_volume: return (1407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b85a81-4e30-4094-b631-6f2e8b827b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a', 'volume_size': 2}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7651717b-a36b-40b0-9667-24acc8cd2676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-fed6123f-07c8-455c-8140-06815393f311 tempest-VolumesServicesTestJSON-816395301 None] Acquiring lock "cinder-47b58e80-1379-4348-a7d8-c5d4de736214-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:51 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Volume volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a (eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a): created successfully Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7651717b-a36b-40b0-9667-24acc8cd2676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Flow 'volume_create_manager' (d0ae33dd-340b-4af1-bce1-93721a7e6b2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:38:51 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-2f995b53-9e90-45b2-8bdc-dabce40b9800 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Created volume successfully. Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-fed6123f-07c8-455c-8140-06815393f311 tempest-VolumesServicesTestJSON-816395301 None] Lock "cinder-47b58e80-1379-4348-a7d8-c5d4de736214-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-fed6123f-07c8-455c-8140-06815393f311 tempest-VolumesServicesTestJSON-816395301 None] Acquiring lock "cinder-quobyte-47b58e80-1379-4348-a7d8-c5d4de736214" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-fed6123f-07c8-455c-8140-06815393f311 tempest-VolumesServicesTestJSON-816395301 None] Lock "cinder-quobyte-47b58e80-1379-4348-a7d8-c5d4de736214" acquired by "delete_volume" :: waited 0.021s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Flow 'volume_create_manager' (edbb2c3a-c6f9-4323-b8ff-877ca6c9b8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bee679-cf49-4013-827f-a50f93b767d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ee4f26-986e-44c9-90e9-2c19a8f2d236]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fed6123f-07c8-455c-8140-06815393f311 tempest-VolumesServicesTestJSON-816395301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-47b58e80-1379-4348-a7d8-c5d4de736214 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bee679-cf49-4013-827f-a50f93b767d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1274553621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5fcf533-aae3-4240-a44e-c5ea8ac4d4bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34a3741e315a4327a5e664047e67b106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:38:51Z,use_quota=True,user_id='68dfd9639bd141f482b5deab75112940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2428b0f3-887e-413f-958d-f089a29276c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2428b0f3-887e-413f-958d-f089a29276c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30cf62f8-84c1-4a4f-a1f2-4793c5259737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30cf62f8-84c1-4a4f-a1f2-4793c5259737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5fcf533-aae3-4240-a44e-c5ea8ac4d4bc', 'volume_name': 'volume-c5fcf533-aae3-4240-a44e-c5ea8ac4d4bc', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5012cdc5-dbe3-4083-a2af-94a9d0e6b41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5012cdc5-dbe3-4083-a2af-94a9d0e6b41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e536dfa0-f76c-4345-85fd-0e69db580d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:51 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Volume c5fcf533-aae3-4240-a44e-c5ea8ac4d4bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5fcf533-aae3-4240-a44e-c5ea8ac4d4bc', 'volume_size': 1} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1274553621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5fcf533-aae3-4240-a44e-c5ea8ac4d4bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34a3741e315a4327a5e664047e67b106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:38:51Z,use_quota=True,user_id='68dfd9639bd141f482b5deab75112940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Creating volume c5fcf533-aae3-4240-a44e-c5ea8ac4d4bc {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:38:51 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:38:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c5fcf533-aae3-4240-a44e-c5ea8ac4d4bc 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:51 devstack sudo[86690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c5fcf533-aae3-4240-a44e-c5ea8ac4d4bc 1073741824 Apr 02 12:38:51 devstack sudo[86690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:51 devstack sudo[86689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-47b58e80-1379-4348-a7d8-c5d4de736214 Apr 02 12:38:51 devstack sudo[86689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-00ab92d4-51fc-4ba6-bcbb-bd98c32ad044 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:52 devstack sudo[86689]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fed6123f-07c8-455c-8140-06815393f311 tempest-VolumesServicesTestJSON-816395301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-47b58e80-1379-4348-a7d8-c5d4de736214" returned: 0 in 0.863s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fed6123f-07c8-455c-8140-06815393f311 tempest-VolumesServicesTestJSON-816395301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-47b58e80-1379-4348-a7d8-c5d4de736214 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:52 devstack sudo[86699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-47b58e80-1379-4348-a7d8-c5d4de736214 Apr 02 12:38:52 devstack sudo[86699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:52 devstack sudo[86690]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c5fcf533-aae3-4240-a44e-c5ea8ac4d4bc 1073741824" returned: 0 in 0.822s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c5fcf533-aae3-4240-a44e-c5ea8ac4d4bc {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:52 devstack sudo[86701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c5fcf533-aae3-4240-a44e-c5ea8ac4d4bc Apr 02 12:38:52 devstack sudo[86701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:53 devstack sudo[86699]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fed6123f-07c8-455c-8140-06815393f311 tempest-VolumesServicesTestJSON-816395301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-47b58e80-1379-4348-a7d8-c5d4de736214" returned: 0 in 0.672s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:53 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-fed6123f-07c8-455c-8140-06815393f311 tempest-VolumesServicesTestJSON-816395301 None] Lock "cinder-quobyte-47b58e80-1379-4348-a7d8-c5d4de736214" released by "delete_volume" :: held 1.594s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:53 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:SELECT=149,cinder:UPDATE=182,cinder:DELETE=18,cinder:INSERT=52 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:38:53 devstack sudo[86701]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c5fcf533-aae3-4240-a44e-c5ea8ac4d4bc" returned: 0 in 0.649s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:53 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:38:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-00ab92d4-51fc-4ba6-bcbb-bd98c32ad044 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.016s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:53 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e536dfa0-f76c-4345-85fd-0e69db580d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5fcf533-aae3-4240-a44e-c5ea8ac4d4bc', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:53 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e81adf3-13cb-4dd8-86ee-fb3710e03cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:53 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-fed6123f-07c8-455c-8140-06815393f311 tempest-VolumesServicesTestJSON-816395301 None] Created reservations ['e528a3d2-7ff3-4b0d-b063-c8eef574d809', 'eb1c5fff-5433-421a-9795-e4264e704a93', 'ca8665fe-a699-4a01-a0f2-697c5b0e8f87', 'bc39e17a-700a-4da2-9a51-dcde25c2ab3b'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:38:53 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Volume volume-c5fcf533-aae3-4240-a44e-c5ea8ac4d4bc (c5fcf533-aae3-4240-a44e-c5ea8ac4d4bc): created successfully Apr 02 12:38:53 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e81adf3-13cb-4dd8-86ee-fb3710e03cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:53 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Flow 'volume_create_manager' (edbb2c3a-c6f9-4323-b8ff-877ca6c9b8e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:38:53 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-17e8d964-7b6d-42ed-a9cb-56bb9ec2c3f4 tempest-VolumesMetadataTest-1695313575 None] Created volume successfully. Apr 02 12:38:53 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-00ab92d4-51fc-4ba6-bcbb-bd98c32ad044 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Creating offline snapshot 04f3e7e5-abd2-49ae-8916-ffdd3bec06b5 of volume eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:38:53 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c08218a-b45c-4e7f-977a-211d7cc4b0cf]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-00ab92d4-51fc-4ba6-bcbb-bd98c32ad044 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-fed6123f-07c8-455c-8140-06815393f311 tempest-VolumesServicesTestJSON-816395301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-fed6123f-07c8-455c-8140-06815393f311 tempest-VolumesServicesTestJSON-816395301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:53 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-fed6123f-07c8-455c-8140-06815393f311 tempest-VolumesServicesTestJSON-816395301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:38:53 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-fed6123f-07c8-455c-8140-06815393f311 tempest-VolumesServicesTestJSON-816395301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:38:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-fed6123f-07c8-455c-8140-06815393f311 tempest-VolumesServicesTestJSON-816395301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fed6123f-07c8-455c-8140-06815393f311 tempest-VolumesServicesTestJSON-816395301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:53 devstack sudo[86723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:38:53 devstack sudo[86723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:53 devstack sudo[86722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a Apr 02 12:38:53 devstack sudo[86722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:53 devstack sudo[86723]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fed6123f-07c8-455c-8140-06815393f311 tempest-VolumesServicesTestJSON-816395301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.590s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:53 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-fed6123f-07c8-455c-8140-06815393f311 tempest-VolumesServicesTestJSON-816395301 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:38:53 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-fed6123f-07c8-455c-8140-06815393f311 tempest-VolumesServicesTestJSON-816395301 None] Deleted volume successfully. Apr 02 12:38:53 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-fed6123f-07c8-455c-8140-06815393f311 tempest-VolumesServicesTestJSON-816395301 None] Lock "cinder-47b58e80-1379-4348-a7d8-c5d4de736214-delete_volume" released by "delete_volume" :: held 2.488s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:54 devstack sudo[86722]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-00ab92d4-51fc-4ba6-bcbb-bd98c32ad044 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a" returned: 0 in 0.907s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-00ab92d4-51fc-4ba6-bcbb-bd98c32ad044 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a.04f3e7e5-abd2-49ae-8916-ffdd3bec06b5 2G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:54 devstack sudo[86730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a.04f3e7e5-abd2-49ae-8916-ffdd3bec06b5 2G Apr 02 12:38:54 devstack sudo[86730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ee9bd70b-8ca3-4ab3-932d-5ebdf523349b tempest-VolumesMetadataTest-1695313575 None] Acquiring lock "cinder-c5fcf533-aae3-4240-a44e-c5ea8ac4d4bc-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ee9bd70b-8ca3-4ab3-932d-5ebdf523349b tempest-VolumesMetadataTest-1695313575 None] Lock "cinder-c5fcf533-aae3-4240-a44e-c5ea8ac4d4bc-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:54 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:SELECT=141,cinder:INSERT=43,cinder:UPDATE=207,cinder:DELETE=14 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:38:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ee9bd70b-8ca3-4ab3-932d-5ebdf523349b tempest-VolumesMetadataTest-1695313575 None] Acquiring lock "cinder-quobyte-c5fcf533-aae3-4240-a44e-c5ea8ac4d4bc" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ee9bd70b-8ca3-4ab3-932d-5ebdf523349b tempest-VolumesMetadataTest-1695313575 None] Lock "cinder-quobyte-c5fcf533-aae3-4240-a44e-c5ea8ac4d4bc" acquired by "delete_volume" :: waited 0.013s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:54 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f66986e-2fa2-473c-8c1e-853a4eb4488b]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ee9bd70b-8ca3-4ab3-932d-5ebdf523349b tempest-VolumesMetadataTest-1695313575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c5fcf533-aae3-4240-a44e-c5ea8ac4d4bc {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:54 devstack sudo[86734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c5fcf533-aae3-4240-a44e-c5ea8ac4d4bc Apr 02 12:38:54 devstack sudo[86734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:55 devstack sudo[86730]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-00ab92d4-51fc-4ba6-bcbb-bd98c32ad044 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a.04f3e7e5-abd2-49ae-8916-ffdd3bec06b5 2G" returned: 0 in 0.836s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-00ab92d4-51fc-4ba6-bcbb-bd98c32ad044 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a.04f3e7e5-abd2-49ae-8916-ffdd3bec06b5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:55 devstack sudo[86772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a.04f3e7e5-abd2-49ae-8916-ffdd3bec06b5 Apr 02 12:38:55 devstack sudo[86772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:55 devstack sudo[86734]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ee9bd70b-8ca3-4ab3-932d-5ebdf523349b tempest-VolumesMetadataTest-1695313575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c5fcf533-aae3-4240-a44e-c5ea8ac4d4bc" returned: 0 in 0.619s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ee9bd70b-8ca3-4ab3-932d-5ebdf523349b tempest-VolumesMetadataTest-1695313575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c5fcf533-aae3-4240-a44e-c5ea8ac4d4bc {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:55 devstack sudo[86788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c5fcf533-aae3-4240-a44e-c5ea8ac4d4bc Apr 02 12:38:55 devstack sudo[86788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:55 devstack sudo[86772]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-00ab92d4-51fc-4ba6-bcbb-bd98c32ad044 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a.04f3e7e5-abd2-49ae-8916-ffdd3bec06b5" returned: 0 in 0.678s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:55 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-00ab92d4-51fc-4ba6-bcbb-bd98c32ad044 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a.04f3e7e5-abd2-49ae-8916-ffdd3bec06b5 is being set with open permissions: ugo+rw Apr 02 12:38:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-00ab92d4-51fc-4ba6-bcbb-bd98c32ad044 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a.04f3e7e5-abd2-49ae-8916-ffdd3bec06b5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:55 devstack sudo[86798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a.04f3e7e5-abd2-49ae-8916-ffdd3bec06b5 Apr 02 12:38:55 devstack sudo[86798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:55 devstack sudo[86788]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ee9bd70b-8ca3-4ab3-932d-5ebdf523349b tempest-VolumesMetadataTest-1695313575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c5fcf533-aae3-4240-a44e-c5ea8ac4d4bc" returned: 0 in 0.549s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:55 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ee9bd70b-8ca3-4ab3-932d-5ebdf523349b tempest-VolumesMetadataTest-1695313575 None] Lock "cinder-quobyte-c5fcf533-aae3-4240-a44e-c5ea8ac4d4bc" released by "delete_volume" :: held 1.217s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:55 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-ee9bd70b-8ca3-4ab3-932d-5ebdf523349b tempest-VolumesMetadataTest-1695313575 None] Created reservations ['59755e88-c2ea-4989-86e6-5cecb162458d', 'c5970361-76a9-4a19-9b15-771a8c32ac84', '4a265c8b-be14-4291-a296-e1aed6b81815', 'dd067cd1-81b8-42ec-b19d-cfa9c29844cf'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:38:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ee9bd70b-8ca3-4ab3-932d-5ebdf523349b tempest-VolumesMetadataTest-1695313575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ee9bd70b-8ca3-4ab3-932d-5ebdf523349b tempest-VolumesMetadataTest-1695313575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:55 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ee9bd70b-8ca3-4ab3-932d-5ebdf523349b tempest-VolumesMetadataTest-1695313575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:38:56 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ee9bd70b-8ca3-4ab3-932d-5ebdf523349b tempest-VolumesMetadataTest-1695313575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:38:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ee9bd70b-8ca3-4ab3-932d-5ebdf523349b tempest-VolumesMetadataTest-1695313575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ee9bd70b-8ca3-4ab3-932d-5ebdf523349b tempest-VolumesMetadataTest-1695313575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:56 devstack sudo[86801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:38:56 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:56 devstack sudo[86798]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-00ab92d4-51fc-4ba6-bcbb-bd98c32ad044 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a.04f3e7e5-abd2-49ae-8916-ffdd3bec06b5" returned: 0 in 0.476s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-00ab92d4-51fc-4ba6-bcbb-bd98c32ad044 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:56 devstack sudo[86804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a.info Apr 02 12:38:56 devstack sudo[86804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:56 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ee9bd70b-8ca3-4ab3-932d-5ebdf523349b tempest-VolumesMetadataTest-1695313575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.649s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:56 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-ee9bd70b-8ca3-4ab3-932d-5ebdf523349b tempest-VolumesMetadataTest-1695313575 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:38:56 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-ee9bd70b-8ca3-4ab3-932d-5ebdf523349b tempest-VolumesMetadataTest-1695313575 None] Deleted volume successfully. Apr 02 12:38:56 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ee9bd70b-8ca3-4ab3-932d-5ebdf523349b tempest-VolumesMetadataTest-1695313575 None] Lock "cinder-c5fcf533-aae3-4240-a44e-c5ea8ac4d4bc-delete_volume" released by "delete_volume" :: held 2.085s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:38:56 devstack sudo[86804]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-00ab92d4-51fc-4ba6-bcbb-bd98c32ad044 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a.info" returned: 0 in 0.494s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:56 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-00ab92d4-51fc-4ba6-bcbb-bd98c32ad044 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a.info is being set with open permissions: ugo+rw Apr 02 12:38:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-00ab92d4-51fc-4ba6-bcbb-bd98c32ad044 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:56 devstack sudo[86808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a.info Apr 02 12:38:56 devstack sudo[86808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:57 devstack sudo[86808]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-00ab92d4-51fc-4ba6-bcbb-bd98c32ad044 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a.info" returned: 0 in 0.441s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-00ab92d4-51fc-4ba6-bcbb-bd98c32ad044 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.961s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:57 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-00ab92d4-51fc-4ba6-bcbb-bd98c32ad044 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Create snapshot completed successfully Apr 02 12:38:57 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b4af4cb6-065a-4b76-a13f-3ee9e7bf2905 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Acquiring lock "cinder-04f3e7e5-abd2-49ae-8916-ffdd3bec06b5-delete_snapshot" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:57 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b4af4cb6-065a-4b76-a13f-3ee9e7bf2905 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Lock "cinder-04f3e7e5-abd2-49ae-8916-ffdd3bec06b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:57 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b4af4cb6-065a-4b76-a13f-3ee9e7bf2905 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Acquiring lock "cinder-quobyte-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:57 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b4af4cb6-065a-4b76-a13f-3ee9e7bf2905 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Lock "cinder-quobyte-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:57 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b4af4cb6-065a-4b76-a13f-3ee9e7bf2905 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Acquiring lock "cinder-quobyte-04f3e7e5-abd2-49ae-8916-ffdd3bec06b5" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:38:57 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b4af4cb6-065a-4b76-a13f-3ee9e7bf2905 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Lock "cinder-quobyte-04f3e7e5-abd2-49ae-8916-ffdd3bec06b5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:38:57 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-b4af4cb6-065a-4b76-a13f-3ee9e7bf2905 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Deleting offline snapshot 04f3e7e5-abd2-49ae-8916-ffdd3bec06b5 of volume eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:38:57 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-b4af4cb6-065a-4b76-a13f-3ee9e7bf2905 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] snapshot_file for this snap is: volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a.04f3e7e5-abd2-49ae-8916-ffdd3bec06b5 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:38:57 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae5f879-0f0c-43ab-812d-4ec988a2d368]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b4af4cb6-065a-4b76-a13f-3ee9e7bf2905 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a.04f3e7e5-abd2-49ae-8916-ffdd3bec06b5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:57 devstack sudo[86815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a.04f3e7e5-abd2-49ae-8916-ffdd3bec06b5 Apr 02 12:38:57 devstack sudo[86815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:58 devstack sudo[86815]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b4af4cb6-065a-4b76-a13f-3ee9e7bf2905 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a.04f3e7e5-abd2-49ae-8916-ffdd3bec06b5" returned: 0 in 0.635s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:58 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-b4af4cb6-065a-4b76-a13f-3ee9e7bf2905 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:38:58 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7730315d-6367-43a6-b46f-c243d2ba61cd]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:38:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b4af4cb6-065a-4b76-a13f-3ee9e7bf2905 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:58 devstack sudo[86820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a Apr 02 12:38:58 devstack sudo[86820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:58 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:38:58 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Flow 'volume_create_manager' (b46a31f4-b618-490a-aea2-73a4821e782e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:38:58 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc3b8b60-43e8-4eea-a234-357fc604c0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:58 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc3b8b60-43e8-4eea-a234-357fc604c0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-390135083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40959755-b187-4b6d-b816-d24395e72ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d09937c81744d4ae54f18a9dc35d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:38:58Z,use_quota=True,user_id='2b18d37161314b87b317f81e34fae8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:58 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb8c3f6e-c3ba-43b6-b6cf-2ae6a2ddd17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:58 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb8c3f6e-c3ba-43b6-b6cf-2ae6a2ddd17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:58 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15656071-a7e8-4502-94fd-2685cb08c90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:58 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15656071-a7e8-4502-94fd-2685cb08c90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40959755-b187-4b6d-b816-d24395e72ec8', 'volume_name': 'volume-40959755-b187-4b6d-b816-d24395e72ec8', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:58 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (756316d8-0461-469a-a0cb-04a95a64164f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:58 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (756316d8-0461-469a-a0cb-04a95a64164f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:38:58 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12eb5b7f-2874-40a0-81d9-50a97e24d7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:38:58 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Volume 40959755-b187-4b6d-b816-d24395e72ec8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40959755-b187-4b6d-b816-d24395e72ec8', 'volume_size': 1} Apr 02 12:38:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:58 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-390135083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40959755-b187-4b6d-b816-d24395e72ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d09937c81744d4ae54f18a9dc35d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:38:58Z,use_quota=True,user_id='2b18d37161314b87b317f81e34fae8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:38:58 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Creating volume 40959755-b187-4b6d-b816-d24395e72ec8 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:38:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:38:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:38:58 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:38:58 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:38:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:38:58 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:38:58 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:38:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:58 devstack sudo[86855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8 1073741824 Apr 02 12:38:58 devstack sudo[86855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:59 devstack sudo[86820]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b4af4cb6-065a-4b76-a13f-3ee9e7bf2905 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a" returned: 0 in 0.928s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b4af4cb6-065a-4b76-a13f-3ee9e7bf2905 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a.04f3e7e5-abd2-49ae-8916-ffdd3bec06b5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:59 devstack sudo[86873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a.04f3e7e5-abd2-49ae-8916-ffdd3bec06b5 Apr 02 12:38:59 devstack sudo[86873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:38:59 devstack sudo[86855]: pam_unix(sudo:session): session closed for user root Apr 02 12:38:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8 1073741824" returned: 0 in 0.984s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:38:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:38:59 devstack sudo[86899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8 Apr 02 12:38:59 devstack sudo[86899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Flow 'volume_create_manager' (5b5ba9e4-5360-4000-b415-891b4e58b5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cef679b-21a3-411a-9c02-1529d51b6da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cef679b-21a3-411a-9c02-1529d51b6da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1997362953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d579e86e-d081-414a-bda7-241be00b2271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03deac8072f9454d9e43fb8cae64a1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:39:00Z,use_quota=True,user_id='863a9971df814026a1a8401a59d2b6a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (462f39b6-07b5-45a2-9126-66b4128ca7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (462f39b6-07b5-45a2-9126-66b4128ca7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c5ff3c-3cc7-4424-9d77-2724dd2e2a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c5ff3c-3cc7-4424-9d77-2724dd2e2a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd579e86e-d081-414a-bda7-241be00b2271', 'volume_name': 'volume-d579e86e-d081-414a-bda7-241be00b2271', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7c9a75-7aa0-4887-aaf7-9c56a1d57120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7c9a75-7aa0-4887-aaf7-9c56a1d57120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cadfdffc-e81f-41d9-a960-644314661295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:00 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Volume d579e86e-d081-414a-bda7-241be00b2271: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d579e86e-d081-414a-bda7-241be00b2271', 'volume_size': 1} Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:00 devstack sudo[86873]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b4af4cb6-065a-4b76-a13f-3ee9e7bf2905 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a.04f3e7e5-abd2-49ae-8916-ffdd3bec06b5" returned: 0 in 1.624s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b4af4cb6-065a-4b76-a13f-3ee9e7bf2905 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a.04f3e7e5-abd2-49ae-8916-ffdd3bec06b5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:00 devstack sudo[86921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a.04f3e7e5-abd2-49ae-8916-ffdd3bec06b5 Apr 02 12:39:00 devstack sudo[86921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:00 devstack sudo[86899]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8" returned: 0 in 1.199s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] <== create_volume: return (2310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.316s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.379s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1997362953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d579e86e-d081-414a-bda7-241be00b2271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03deac8072f9454d9e43fb8cae64a1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:39:00Z,use_quota=True,user_id='863a9971df814026a1a8401a59d2b6a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Creating volume d579e86e-d081-414a-bda7-241be00b2271 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:39:00 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12eb5b7f-2874-40a0-81d9-50a97e24d7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40959755-b187-4b6d-b816-d24395e72ec8', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:00 devstack sudo[86924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271 1073741824 Apr 02 12:39:00 devstack sudo[86924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34d4db34-5024-4828-a0a6-7b28dd2965d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:00 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Volume volume-40959755-b187-4b6d-b816-d24395e72ec8 (40959755-b187-4b6d-b816-d24395e72ec8): created successfully Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34d4db34-5024-4828-a0a6-7b28dd2965d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Flow 'volume_create_manager' (b46a31f4-b618-490a-aea2-73a4821e782e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:39:00 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-848ddc2c-27fa-4a6e-a572-4f7572809e8a tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Created volume successfully. Apr 02 12:39:01 devstack sudo[86921]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b4af4cb6-065a-4b76-a13f-3ee9e7bf2905 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a.04f3e7e5-abd2-49ae-8916-ffdd3bec06b5" returned: 0 in 0.578s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:01 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b4af4cb6-065a-4b76-a13f-3ee9e7bf2905 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Lock "cinder-quobyte-04f3e7e5-abd2-49ae-8916-ffdd3bec06b5" released by "_delete_snapshot" :: held 3.834s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:01 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b4af4cb6-065a-4b76-a13f-3ee9e7bf2905 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Lock "cinder-quobyte-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a" released by "delete_snapshot" :: held 3.854s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:01 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-b4af4cb6-065a-4b76-a13f-3ee9e7bf2905 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Created reservations ['a4d8f749-ff01-4ada-84c4-e61fe24ef470', 'a0cce816-393a-4463-926b-f7abbbdc1eed', '1f9963ae-afe5-415c-be69-a75f103a8f5a', '19e1a319-518c-41a2-a7e8-8bdf6872da7d'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:39:01 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-b4af4cb6-065a-4b76-a13f-3ee9e7bf2905 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Delete snapshot completed successfully. Apr 02 12:39:01 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b4af4cb6-065a-4b76-a13f-3ee9e7bf2905 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Lock "cinder-04f3e7e5-abd2-49ae-8916-ffdd3bec06b5-delete_snapshot" released by "delete_snapshot" :: held 3.975s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:01 devstack sudo[86924]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271 1073741824" returned: 0 in 0.701s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:01 devstack sudo[86932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271 Apr 02 12:39:01 devstack sudo[86932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:02 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-eda25c47-3eb8-4201-b410-39b1aa9a5df6 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Acquiring lock "cinder-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:02 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-eda25c47-3eb8-4201-b410-39b1aa9a5df6 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Lock "cinder-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-67672e2a-d5cb-42a9-8ecb-10cbc8324758 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:02 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-eda25c47-3eb8-4201-b410-39b1aa9a5df6 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Acquiring lock "cinder-quobyte-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:02 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-eda25c47-3eb8-4201-b410-39b1aa9a5df6 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Lock "cinder-quobyte-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a" acquired by "delete_volume" :: waited 0.017s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:02 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e1ff73-2151-43d6-9f14-368359e3c440]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:39:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-eda25c47-3eb8-4201-b410-39b1aa9a5df6 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:02 devstack sudo[86932]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271" returned: 0 in 0.791s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:02 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:39:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-67672e2a-d5cb-42a9-8ecb-10cbc8324758 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.136s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cadfdffc-e81f-41d9-a960-644314661295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d579e86e-d081-414a-bda7-241be00b2271', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e27ea9-d8c2-4cf7-b989-75ecd74f65d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:02 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-67672e2a-d5cb-42a9-8ecb-10cbc8324758 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Creating offline snapshot 28f07836-68db-4f11-a39c-160485b9edae of volume 40959755-b187-4b6d-b816-d24395e72ec8 {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:39:02 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Volume volume-d579e86e-d081-414a-bda7-241be00b2271 (d579e86e-d081-414a-bda7-241be00b2271): created successfully Apr 02 12:39:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e27ea9-d8c2-4cf7-b989-75ecd74f65d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Flow 'volume_create_manager' (5b5ba9e4-5360-4000-b415-891b4e58b5ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:39:02 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2411d46-5e60-42c7-a78e-9b7be501c4bc]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:39:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-67672e2a-d5cb-42a9-8ecb-10cbc8324758 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:02 devstack sudo[86935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a Apr 02 12:39:02 devstack sudo[86935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:02 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-6adb4d39-10b0-4772-adc5-05860b00eabd tempest-VolumesCloneTest-1117089562 None] Created volume successfully. Apr 02 12:39:02 devstack sudo[86936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8 Apr 02 12:39:02 devstack sudo[86936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:02 devstack sudo[86935]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-eda25c47-3eb8-4201-b410-39b1aa9a5df6 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a" returned: 0 in 0.626s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-eda25c47-3eb8-4201-b410-39b1aa9a5df6 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:03 devstack sudo[86942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a Apr 02 12:39:03 devstack sudo[86942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:03 devstack sudo[86936]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-67672e2a-d5cb-42a9-8ecb-10cbc8324758 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8" returned: 0 in 0.660s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-67672e2a-d5cb-42a9-8ecb-10cbc8324758 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8.28f07836-68db-4f11-a39c-160485b9edae 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:03 devstack sudo[86947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8.28f07836-68db-4f11-a39c-160485b9edae 1G Apr 02 12:39:03 devstack sudo[86947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:03 devstack sudo[86942]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-eda25c47-3eb8-4201-b410-39b1aa9a5df6 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a" returned: 0 in 0.917s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:03 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-eda25c47-3eb8-4201-b410-39b1aa9a5df6 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Lock "cinder-quobyte-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a" released by "delete_volume" :: held 1.593s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:04 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-eda25c47-3eb8-4201-b410-39b1aa9a5df6 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Created reservations ['9b9f46ff-40a7-4557-82d8-ad647c35c26e', '459153ea-2aea-44bc-9733-4f4c02ab39e7', 'ef51d0b1-a5ff-4840-8f3b-4fa2a7e5c285', 'ffabe577-0d16-435d-93a7-1b9342d82522'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:39:04 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:39:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Flow 'volume_create_manager' (b16e7cad-9d4b-4d91-8ab6-6488ffa11a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:39:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a738a1fc-6386-481f-9a2f-6269fba1e7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a738a1fc-6386-481f-9a2f-6269fba1e7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2061910831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f591b0f-eea6-4811-b68b-d4555cc3724d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03deac8072f9454d9e43fb8cae64a1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:39:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=d579e86e-d081-414a-bda7-241be00b2271,status='creating',terminated_at=None,updated_at=2026-04-02T10:39:04Z,use_quota=True,user_id='863a9971df814026a1a8401a59d2b6a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6ffcce8-9cf0-4d42-8f36-a7eb3ac91b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6ffcce8-9cf0-4d42-8f36-a7eb3ac91b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f276deb4-5ec6-49b7-91a7-87ff17c72645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f276deb4-5ec6-49b7-91a7-87ff17c72645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9f591b0f-eea6-4811-b68b-d4555cc3724d', 'volume_name': 'volume-9f591b0f-eea6-4811-b68b-d4555cc3724d', 'volume_size': 2, 'source_volid': 'd579e86e-d081-414a-bda7-241be00b2271', 'source_volstatus': 'available'}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:04 devstack sudo[86947]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1490946-abf9-44ab-a639-cfaeaab8d41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1490946-abf9-44ab-a639-cfaeaab8d41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1248e394-dbe9-4e2d-9ddb-7b32c910c6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:04 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Volume 9f591b0f-eea6-4811-b68b-d4555cc3724d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9f591b0f-eea6-4811-b68b-d4555cc3724d', 'volume_size': 2, 'source_volid': 'd579e86e-d081-414a-bda7-241be00b2271', 'source_volstatus': 'available'} Apr 02 12:39:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-67672e2a-d5cb-42a9-8ecb-10cbc8324758 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8.28f07836-68db-4f11-a39c-160485b9edae 1G" returned: 0 in 1.071s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-67672e2a-d5cb-42a9-8ecb-10cbc8324758 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40959755-b187-4b6d-b816-d24395e72ec8 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8.28f07836-68db-4f11-a39c-160485b9edae {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:04 devstack sudo[86954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40959755-b187-4b6d-b816-d24395e72ec8 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8.28f07836-68db-4f11-a39c-160485b9edae Apr 02 12:39:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-eda25c47-3eb8-4201-b410-39b1aa9a5df6 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-eda25c47-3eb8-4201-b410-39b1aa9a5df6 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:04 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-eda25c47-3eb8-4201-b410-39b1aa9a5df6 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:39:04 devstack sudo[86954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:04 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-eda25c47-3eb8-4201-b410-39b1aa9a5df6 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:39:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-eda25c47-3eb8-4201-b410-39b1aa9a5df6 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-eda25c47-3eb8-4201-b410-39b1aa9a5df6 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:04 devstack sudo[86956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:39:04 devstack sudo[86956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:04 devstack sudo[86956]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-eda25c47-3eb8-4201-b410-39b1aa9a5df6 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.594s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:04 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-eda25c47-3eb8-4201-b410-39b1aa9a5df6 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:39:04 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-eda25c47-3eb8-4201-b410-39b1aa9a5df6 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Deleted volume successfully. Apr 02 12:39:04 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-eda25c47-3eb8-4201-b410-39b1aa9a5df6 tempest-VolumesSnapshotNegativeTestJSON-1263246794 None] Lock "cinder-eb2ba7e2-5fae-4768-9b8a-fe8a0f10113a-delete_volume" released by "delete_volume" :: held 2.709s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:04 devstack sudo[86954]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-67672e2a-d5cb-42a9-8ecb-10cbc8324758 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40959755-b187-4b6d-b816-d24395e72ec8 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8.28f07836-68db-4f11-a39c-160485b9edae" returned: 0 in 0.712s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:04 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-67672e2a-d5cb-42a9-8ecb-10cbc8324758 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8.28f07836-68db-4f11-a39c-160485b9edae is being set with open permissions: ugo+rw Apr 02 12:39:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-67672e2a-d5cb-42a9-8ecb-10cbc8324758 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8.28f07836-68db-4f11-a39c-160485b9edae {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:04 devstack sudo[86962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8.28f07836-68db-4f11-a39c-160485b9edae Apr 02 12:39:04 devstack sudo[86962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:05 devstack sudo[86962]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-67672e2a-d5cb-42a9-8ecb-10cbc8324758 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8.28f07836-68db-4f11-a39c-160485b9edae" returned: 0 in 1.031s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-67672e2a-d5cb-42a9-8ecb-10cbc8324758 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:06 devstack sudo[86965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8.info Apr 02 12:39:06 devstack sudo[86965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:06 devstack sudo[86965]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-67672e2a-d5cb-42a9-8ecb-10cbc8324758 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8.info" returned: 0 in 0.755s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:06 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-67672e2a-d5cb-42a9-8ecb-10cbc8324758 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8.info is being set with open permissions: ugo+rw Apr 02 12:39:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-67672e2a-d5cb-42a9-8ecb-10cbc8324758 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:06 devstack sudo[86968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8.info Apr 02 12:39:06 devstack sudo[86968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:07 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:39:07 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Flow 'volume_create_manager' (6c4a9112-1e94-47a2-8832-b5b33d42ef0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:39:07 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ebc90d-ae67-4900-9426-54d0d03a1bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:07 devstack sudo[86968]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:07 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ebc90d-ae67-4900-9426-54d0d03a1bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-109953784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddb799e9-dad5-42bb-a834-b1e22ba1a312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3223ba802de4b2aaf310bedafe91f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:39:07Z,use_quota=True,user_id='426084cf15bc496180d6d7badf012fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:07 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62448b55-bd80-493c-855a-02b03a6ad821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:07 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62448b55-bd80-493c-855a-02b03a6ad821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:07 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8850713-d4bb-45fe-9f6e-f6e2db2cce63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:07 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8850713-d4bb-45fe-9f6e-f6e2db2cce63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddb799e9-dad5-42bb-a834-b1e22ba1a312', 'volume_name': 'volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:07 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35e60048-6a5c-41fa-9ea8-ece2243848c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:07 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35e60048-6a5c-41fa-9ea8-ece2243848c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:07 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b95728-1fb1-4642-8c78-ade83d0ab9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:07 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Volume ddb799e9-dad5-42bb-a834-b1e22ba1a312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312', 'volume_size': 1} Apr 02 12:39:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-67672e2a-d5cb-42a9-8ecb-10cbc8324758 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8.info" returned: 0 in 1.036s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-67672e2a-d5cb-42a9-8ecb-10cbc8324758 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.385s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.557s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:07 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Cloning volume d579e86e-d081-414a-bda7-241be00b2271 to volume 9f591b0f-eea6-4811-b68b-d4555cc3724d Apr 02 12:39:07 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Creating offline snapshot c00a9058-a597-47af-9841-3024e040fac9 of volume d579e86e-d081-414a-bda7-241be00b2271 {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:39:07 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-67672e2a-d5cb-42a9-8ecb-10cbc8324758 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Create snapshot completed successfully Apr 02 12:39:07 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d37c2cc-ec65-451a-be9a-36994b94c0e2]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:39:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:08 devstack sudo[86997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271 Apr 02 12:39:08 devstack sudo[86997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:08 devstack sudo[86997]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271" returned: 0 in 0.694s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.c00a9058-a597-47af-9841-3024e040fac9 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:08 devstack sudo[87005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.c00a9058-a597-47af-9841-3024e040fac9 1G Apr 02 12:39:08 devstack sudo[87005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:08 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7f324948-5bdb-45ec-b232-ab82a3b85604 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Acquiring lock "cinder-28f07836-68db-4f11-a39c-160485b9edae-delete_snapshot" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:08 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7f324948-5bdb-45ec-b232-ab82a3b85604 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Lock "cinder-28f07836-68db-4f11-a39c-160485b9edae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:08 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7f324948-5bdb-45ec-b232-ab82a3b85604 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Acquiring lock "cinder-quobyte-40959755-b187-4b6d-b816-d24395e72ec8" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:08 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7f324948-5bdb-45ec-b232-ab82a3b85604 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Lock "cinder-quobyte-40959755-b187-4b6d-b816-d24395e72ec8" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:08 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7f324948-5bdb-45ec-b232-ab82a3b85604 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Acquiring lock "cinder-quobyte-28f07836-68db-4f11-a39c-160485b9edae" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:08 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7f324948-5bdb-45ec-b232-ab82a3b85604 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Lock "cinder-quobyte-28f07836-68db-4f11-a39c-160485b9edae" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:08 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-7f324948-5bdb-45ec-b232-ab82a3b85604 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Deleting offline snapshot 28f07836-68db-4f11-a39c-160485b9edae of volume 40959755-b187-4b6d-b816-d24395e72ec8 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:39:08 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-7f324948-5bdb-45ec-b232-ab82a3b85604 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] snapshot_file for this snap is: volume-40959755-b187-4b6d-b816-d24395e72ec8.28f07836-68db-4f11-a39c-160485b9edae {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:39:08 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f609711-bae3-4fda-be8f-940cf9228ae0]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:39:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7f324948-5bdb-45ec-b232-ab82a3b85604 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8.28f07836-68db-4f11-a39c-160485b9edae {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:08 devstack sudo[87009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8.28f07836-68db-4f11-a39c-160485b9edae Apr 02 12:39:08 devstack sudo[87009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:09 devstack sudo[87005]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.c00a9058-a597-47af-9841-3024e040fac9 1G" returned: 0 in 0.578s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d579e86e-d081-414a-bda7-241be00b2271 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.c00a9058-a597-47af-9841-3024e040fac9 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:09 devstack sudo[87020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d579e86e-d081-414a-bda7-241be00b2271 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.c00a9058-a597-47af-9841-3024e040fac9 Apr 02 12:39:09 devstack sudo[87020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:09 devstack sudo[87009]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7f324948-5bdb-45ec-b232-ab82a3b85604 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8.28f07836-68db-4f11-a39c-160485b9edae" returned: 0 in 0.593s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:09 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-7f324948-5bdb-45ec-b232-ab82a3b85604 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40959755-b187-4b6d-b816-d24395e72ec8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:39:09 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e3bd3d-031c-47a0-b512-ab5327b1c074]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:39:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7f324948-5bdb-45ec-b232-ab82a3b85604 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:09 devstack sudo[87025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8 Apr 02 12:39:09 devstack sudo[87025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:09 devstack sudo[87020]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d579e86e-d081-414a-bda7-241be00b2271 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.c00a9058-a597-47af-9841-3024e040fac9" returned: 0 in 0.457s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:09 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.c00a9058-a597-47af-9841-3024e040fac9 is being set with open permissions: ugo+rw Apr 02 12:39:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.c00a9058-a597-47af-9841-3024e040fac9 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:09 devstack sudo[87030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.c00a9058-a597-47af-9841-3024e040fac9 Apr 02 12:39:09 devstack sudo[87030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:10 devstack sudo[87025]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7f324948-5bdb-45ec-b232-ab82a3b85604 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8" returned: 0 in 0.517s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7f324948-5bdb-45ec-b232-ab82a3b85604 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8.28f07836-68db-4f11-a39c-160485b9edae {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:10 devstack sudo[87036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8.28f07836-68db-4f11-a39c-160485b9edae Apr 02 12:39:10 devstack sudo[87036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:10 devstack sudo[87030]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.c00a9058-a597-47af-9841-3024e040fac9" returned: 0 in 0.436s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:10 devstack sudo[87038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.info Apr 02 12:39:10 devstack sudo[87038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:10 devstack sudo[87036]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7f324948-5bdb-45ec-b232-ab82a3b85604 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8.28f07836-68db-4f11-a39c-160485b9edae" returned: 0 in 0.526s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7f324948-5bdb-45ec-b232-ab82a3b85604 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8.28f07836-68db-4f11-a39c-160485b9edae {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:10 devstack sudo[87045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8.28f07836-68db-4f11-a39c-160485b9edae Apr 02 12:39:10 devstack sudo[87045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:10 devstack sudo[87038]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.info" returned: 0 in 0.514s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:10 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.info is being set with open permissions: ugo+rw Apr 02 12:39:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:10 devstack sudo[87047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.info Apr 02 12:39:10 devstack sudo[87047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:11 devstack sudo[87045]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7f324948-5bdb-45ec-b232-ab82a3b85604 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8.28f07836-68db-4f11-a39c-160485b9edae" returned: 0 in 0.459s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:11 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7f324948-5bdb-45ec-b232-ab82a3b85604 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Lock "cinder-quobyte-28f07836-68db-4f11-a39c-160485b9edae" released by "_delete_snapshot" :: held 2.155s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:11 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7f324948-5bdb-45ec-b232-ab82a3b85604 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Lock "cinder-quobyte-40959755-b187-4b6d-b816-d24395e72ec8" released by "delete_snapshot" :: held 2.169s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:11 devstack sudo[87047]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.info" returned: 0 in 0.471s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:11 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Acquiring lock "cinder-quobyte-9f591b0f-eea6-4811-b68b-d4555cc3724d" by "_copy_volume_from_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:11 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Lock "cinder-quobyte-9f591b0f-eea6-4811-b68b-d4555cc3724d" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:11 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] snapshot: c00a9058-a597-47af-9841-3024e040fac9, volume: 9f591b0f-eea6-4811-b68b-d4555cc3724d, {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 12:39:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:11 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:39:11 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:39:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:11 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-7f324948-5bdb-45ec-b232-ab82a3b85604 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Created reservations ['9cc01de8-7db3-48a7-b3e5-52d044a9f10f', '8620d589-5f57-4116-8417-208d6f4928b9', '3d1083ce-2644-4fda-a193-fda01ab4f9c4', '81c10b10-dcb1-49ac-8321-93493a24af60'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:39:11 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[808286bb-fff8-46b7-937e-3b312e44f788]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:39:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.c00a9058-a597-47af-9841-3024e040fac9 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:11 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-7f324948-5bdb-45ec-b232-ab82a3b85604 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Delete snapshot completed successfully. Apr 02 12:39:11 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7f324948-5bdb-45ec-b232-ab82a3b85604 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Lock "cinder-28f07836-68db-4f11-a39c-160485b9edae-delete_snapshot" released by "delete_snapshot" :: held 2.353s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:11 devstack sudo[87052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.c00a9058-a597-47af-9841-3024e040fac9 Apr 02 12:39:11 devstack sudo[87052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:11 devstack sudo[87052]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.c00a9058-a597-47af-9841-3024e040fac9" returned: 0 in 0.580s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:11 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d579e86e-d081-414a-bda7-241be00b2271(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:39:11 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271 {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 12:39:11 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Creating direct copy from snapshot {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 12:39:11 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb4a332-36cc-48f6-9b37-f6248d0a658b]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:39:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:11 devstack sudo[87057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271 Apr 02 12:39:11 devstack sudo[87057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:12 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d8f43b13-65d4-4ebe-9447-cab1c1212a39 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Acquiring lock "cinder-40959755-b187-4b6d-b816-d24395e72ec8-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:12 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d8f43b13-65d4-4ebe-9447-cab1c1212a39 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Lock "cinder-40959755-b187-4b6d-b816-d24395e72ec8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:12 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d8f43b13-65d4-4ebe-9447-cab1c1212a39 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Acquiring lock "cinder-quobyte-40959755-b187-4b6d-b816-d24395e72ec8" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:12 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d8f43b13-65d4-4ebe-9447-cab1c1212a39 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Lock "cinder-quobyte-40959755-b187-4b6d-b816-d24395e72ec8" acquired by "delete_volume" :: waited 0.017s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:12 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[897f279d-9149-4327-b38f-a1c032834301]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:39:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d8f43b13-65d4-4ebe-9447-cab1c1212a39 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:12 devstack sudo[87062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8 Apr 02 12:39:12 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:12 devstack sudo[87057]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271" returned: 0 in 0.560s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:12 devstack cinder-volume[82819]: DEBUG cinder.utils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Path /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9f591b0f-eea6-4811-b68b-d4555cc3724d not found in is_blk_device check {{(pid=82819) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 12:39:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9f591b0f-eea6-4811-b68b-d4555cc3724d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:12 devstack sudo[87064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9f591b0f-eea6-4811-b68b-d4555cc3724d Apr 02 12:39:12 devstack sudo[87064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:12 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d8f43b13-65d4-4ebe-9447-cab1c1212a39 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8" returned: 0 in 0.713s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d8f43b13-65d4-4ebe-9447-cab1c1212a39 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:12 devstack sudo[87099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8 Apr 02 12:39:12 devstack sudo[87099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:13 devstack cinder-volume[82819]: DEBUG oslo_service.periodic_task [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82819) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 12:39:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:39:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:39:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:13 devstack sudo[87102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:39:13 devstack sudo[87102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:14 devstack sudo[87099]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d8f43b13-65d4-4ebe-9447-cab1c1212a39 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-40959755-b187-4b6d-b816-d24395e72ec8" returned: 0 in 1.833s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:14 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d8f43b13-65d4-4ebe-9447-cab1c1212a39 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Lock "cinder-quobyte-40959755-b187-4b6d-b816-d24395e72ec8" released by "delete_volume" :: held 2.613s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:15 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-d8f43b13-65d4-4ebe-9447-cab1c1212a39 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Created reservations ['002b80e1-2fe7-4145-ba5f-acdda42930c1', '532dec13-e444-44d8-abd5-8956fe2324a9', '2c862a95-5c93-41be-b092-0b0840866d1e', '670e0973-d3a9-452a-ba25-6b896d4b9faa'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:39:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d8f43b13-65d4-4ebe-9447-cab1c1212a39 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d8f43b13-65d4-4ebe-9447-cab1c1212a39 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:15 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-d8f43b13-65d4-4ebe-9447-cab1c1212a39 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:39:15 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-d8f43b13-65d4-4ebe-9447-cab1c1212a39 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:39:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d8f43b13-65d4-4ebe-9447-cab1c1212a39 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d8f43b13-65d4-4ebe-9447-cab1c1212a39 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:15 devstack sudo[87116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:39:15 devstack sudo[87116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:15 devstack sudo[87102]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 2.214s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:15 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:39:17 devstack sudo[87064]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9f591b0f-eea6-4811-b68b-d4555cc3724d" returned: 0 in 5.015s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:17 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59b1d01-52cd-42d8-8ecb-b8c892f3ad48]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:39:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:17 devstack sudo[87120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271 Apr 02 12:39:17 devstack sudo[87120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:17 devstack sudo[87116]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d8f43b13-65d4-4ebe-9447-cab1c1212a39 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 2.343s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:17 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-d8f43b13-65d4-4ebe-9447-cab1c1212a39 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:39:17 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-d8f43b13-65d4-4ebe-9447-cab1c1212a39 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Deleted volume successfully. Apr 02 12:39:17 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d8f43b13-65d4-4ebe-9447-cab1c1212a39 tempest-VolumeSnapshotQuotasNegativeTestJSON-714448144 None] Lock "cinder-40959755-b187-4b6d-b816-d24395e72ec8-delete_volume" released by "delete_volume" :: held 5.410s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:17 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:39:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Flow 'volume_create_manager' (da7a5884-dddd-45de-bc88-e07d2b4d621b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:39:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (012f2ece-841f-4539-8e53-6f1e991458a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (012f2ece-841f-4539-8e53-6f1e991458a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-301959443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2135ddb-1349-46a5-8fc7-238b7fd78593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87903c101504f60945e9380bdb83911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:39:18Z,use_quota=True,user_id='b10639e272214b8ab4b2d29c45caf503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3871f9cd-de7f-4d33-90b7-9ce171b67a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3871f9cd-de7f-4d33-90b7-9ce171b67a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b03f9533-fe06-4ba1-bee2-e1cb28436676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b03f9533-fe06-4ba1-bee2-e1cb28436676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2135ddb-1349-46a5-8fc7-238b7fd78593', 'volume_name': 'volume-a2135ddb-1349-46a5-8fc7-238b7fd78593', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c715733f-4da4-4404-963c-0e939e8843f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c715733f-4da4-4404-963c-0e939e8843f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7919f180-2277-4a11-949d-9d801928269e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:17 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Volume a2135ddb-1349-46a5-8fc7-238b7fd78593: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2135ddb-1349-46a5-8fc7-238b7fd78593', 'volume_size': 1} Apr 02 12:39:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:18 devstack sudo[87120]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271" returned: 0 in 0.878s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:18 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271, size 1024.00 MB, duration 5.02 sec, destination /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9f591b0f-eea6-4811-b68b-d4555cc3724d {{(pid=82819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 12:39:18 devstack cinder-volume[82819]: INFO cinder.image.image_utils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Converted 1024.00 MB image at 204.13 MB/s Apr 02 12:39:18 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9f591b0f-eea6-4811-b68b-d4555cc3724d is being set with open permissions: ugo+rw Apr 02 12:39:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9f591b0f-eea6-4811-b68b-d4555cc3724d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:18 devstack sudo[87127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9f591b0f-eea6-4811-b68b-d4555cc3724d Apr 02 12:39:18 devstack sudo[87127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:18 devstack sudo[87127]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9f591b0f-eea6-4811-b68b-d4555cc3724d" returned: 0 in 0.610s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Lock "cinder-quobyte-9f591b0f-eea6-4811-b68b-d4555cc3724d" released by "_copy_volume_from_snapshot" :: held 7.699s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Acquiring lock "cinder-quobyte-c00a9058-a597-47af-9841-3024e040fac9" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Lock "cinder-quobyte-c00a9058-a597-47af-9841-3024e040fac9" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:18 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Deleting offline snapshot c00a9058-a597-47af-9841-3024e040fac9 of volume d579e86e-d081-414a-bda7-241be00b2271 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:39:18 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] snapshot_file for this snap is: volume-d579e86e-d081-414a-bda7-241be00b2271.c00a9058-a597-47af-9841-3024e040fac9 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:39:18 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e724f4-9fa2-478d-a35d-230661c304b1]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:39:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.c00a9058-a597-47af-9841-3024e040fac9 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:18 devstack sudo[87131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.c00a9058-a597-47af-9841-3024e040fac9 Apr 02 12:39:18 devstack sudo[87131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:19 devstack sudo[87131]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.c00a9058-a597-47af-9841-3024e040fac9" returned: 0 in 0.627s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:19 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d579e86e-d081-414a-bda7-241be00b2271(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:39:19 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f42264b-55c3-494b-88ff-886fc23c9e29]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:39:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:19 devstack sudo[87136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271 Apr 02 12:39:19 devstack sudo[87136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:20 devstack sudo[87136]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271" returned: 0 in 0.513s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.c00a9058-a597-47af-9841-3024e040fac9 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:20 devstack sudo[87141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.c00a9058-a597-47af-9841-3024e040fac9 Apr 02 12:39:20 devstack sudo[87141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:20 devstack sudo[87141]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.c00a9058-a597-47af-9841-3024e040fac9" returned: 0 in 0.633s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.c00a9058-a597-47af-9841-3024e040fac9 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:20 devstack sudo[87146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.c00a9058-a597-47af-9841-3024e040fac9 Apr 02 12:39:20 devstack sudo[87146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:21 devstack sudo[87146]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271.c00a9058-a597-47af-9841-3024e040fac9" returned: 0 in 0.468s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:21 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Lock "cinder-quobyte-c00a9058-a597-47af-9841-3024e040fac9" released by "_delete_snapshot" :: held 2.336s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.411s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.435s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:21 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-109953784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddb799e9-dad5-42bb-a834-b1e22ba1a312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3223ba802de4b2aaf310bedafe91f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:39:07Z,use_quota=True,user_id='426084cf15bc496180d6d7badf012fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:39:21 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Creating volume ddb799e9-dad5-42bb-a834-b1e22ba1a312 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:39:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:21 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:39:21 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:39:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:21 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:39:21 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:39:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:21 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1248e394-dbe9-4e2d-9ddb-7b32c910c6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f591b0f-eea6-4811-b68b-d4555cc3724d', 'volume_size': 2, 'source_volid': 'd579e86e-d081-414a-bda7-241be00b2271', 'source_volstatus': 'available'}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:21 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90dbf277-7a16-4518-a0b7-0b7ce385cda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:21 devstack sudo[87149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312 1073741824 Apr 02 12:39:21 devstack sudo[87149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:21 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Volume volume-9f591b0f-eea6-4811-b68b-d4555cc3724d (9f591b0f-eea6-4811-b68b-d4555cc3724d): created successfully Apr 02 12:39:21 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90dbf277-7a16-4518-a0b7-0b7ce385cda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:21 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Flow 'volume_create_manager' (b16e7cad-9d4b-4d91-8ab6-6488ffa11a31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:39:21 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-a3cdbbb4-f208-4b87-82d9-1d8b13d6ef56 tempest-VolumesCloneTest-1117089562 None] Created volume successfully. Apr 02 12:39:21 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0173d081-a420-49ee-9bc6-5618361df1ca tempest-VolumesCloneTest-1117089562 None] Acquiring lock "cinder-9f591b0f-eea6-4811-b68b-d4555cc3724d-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:21 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0173d081-a420-49ee-9bc6-5618361df1ca tempest-VolumesCloneTest-1117089562 None] Lock "cinder-9f591b0f-eea6-4811-b68b-d4555cc3724d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:21 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0173d081-a420-49ee-9bc6-5618361df1ca tempest-VolumesCloneTest-1117089562 None] Acquiring lock "cinder-quobyte-9f591b0f-eea6-4811-b68b-d4555cc3724d" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:21 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0173d081-a420-49ee-9bc6-5618361df1ca tempest-VolumesCloneTest-1117089562 None] Lock "cinder-quobyte-9f591b0f-eea6-4811-b68b-d4555cc3724d" acquired by "delete_volume" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:21 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[799f82d3-e296-478c-8461-da272566a8f7]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:39:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0173d081-a420-49ee-9bc6-5618361df1ca tempest-VolumesCloneTest-1117089562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9f591b0f-eea6-4811-b68b-d4555cc3724d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:21 devstack sudo[87153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9f591b0f-eea6-4811-b68b-d4555cc3724d Apr 02 12:39:21 devstack sudo[87153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:22 devstack sudo[87149]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312 1073741824" returned: 0 in 1.008s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:22 devstack sudo[87157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312 Apr 02 12:39:22 devstack sudo[87157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:22 devstack sudo[87153]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0173d081-a420-49ee-9bc6-5618361df1ca tempest-VolumesCloneTest-1117089562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9f591b0f-eea6-4811-b68b-d4555cc3724d" returned: 0 in 1.072s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0173d081-a420-49ee-9bc6-5618361df1ca tempest-VolumesCloneTest-1117089562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9f591b0f-eea6-4811-b68b-d4555cc3724d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:22 devstack sudo[87166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9f591b0f-eea6-4811-b68b-d4555cc3724d Apr 02 12:39:23 devstack sudo[87166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:23 devstack sudo[87157]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312" returned: 0 in 0.977s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:23 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] <== create_volume: return (2024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:39:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.027s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.436s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:23 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-301959443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2135ddb-1349-46a5-8fc7-238b7fd78593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87903c101504f60945e9380bdb83911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:39:18Z,use_quota=True,user_id='b10639e272214b8ab4b2d29c45caf503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:39:23 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Creating volume a2135ddb-1349-46a5-8fc7-238b7fd78593 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:39:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:23 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:39:23 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:39:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:23 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:39:23 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:39:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a2135ddb-1349-46a5-8fc7-238b7fd78593 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:23 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b95728-1fb1-4642-8c78-ade83d0ab9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:23 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0433a24-3d1e-49e3-9d57-a754ca6b3507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:23 devstack sudo[87207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a2135ddb-1349-46a5-8fc7-238b7fd78593 1073741824 Apr 02 12:39:23 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:23 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Volume volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312 (ddb799e9-dad5-42bb-a834-b1e22ba1a312): created successfully Apr 02 12:39:23 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0433a24-3d1e-49e3-9d57-a754ca6b3507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:23 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Flow 'volume_create_manager' (6c4a9112-1e94-47a2-8832-b5b33d42ef0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:39:23 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-2b7103de-60a5-436b-b263-ba6d9988fe7f tempest-CreateVolumesFromSnapshotTest-1233139760 None] Created volume successfully. Apr 02 12:39:24 devstack sudo[87166]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0173d081-a420-49ee-9bc6-5618361df1ca tempest-VolumesCloneTest-1117089562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9f591b0f-eea6-4811-b68b-d4555cc3724d" returned: 0 in 1.141s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:24 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0173d081-a420-49ee-9bc6-5618361df1ca tempest-VolumesCloneTest-1117089562 None] Lock "cinder-quobyte-9f591b0f-eea6-4811-b68b-d4555cc3724d" released by "delete_volume" :: held 2.267s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-f614ad5f-53cb-490e-8a19-17d05c4d1cb0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:24 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-0173d081-a420-49ee-9bc6-5618361df1ca tempest-VolumesCloneTest-1117089562 None] Created reservations ['20da8e0d-552a-49ee-b696-0614c77d4dd3', '96ff6b97-5bec-4c16-9bc6-fcaf601865b1', 'ffb776d0-8d77-4331-a8fa-73f92c177c04', 'd04be945-f996-4399-9fe7-d1bf54337789'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:39:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0173d081-a420-49ee-9bc6-5618361df1ca tempest-VolumesCloneTest-1117089562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0173d081-a420-49ee-9bc6-5618361df1ca tempest-VolumesCloneTest-1117089562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:24 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-0173d081-a420-49ee-9bc6-5618361df1ca tempest-VolumesCloneTest-1117089562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:39:24 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-0173d081-a420-49ee-9bc6-5618361df1ca tempest-VolumesCloneTest-1117089562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:39:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0173d081-a420-49ee-9bc6-5618361df1ca tempest-VolumesCloneTest-1117089562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0173d081-a420-49ee-9bc6-5618361df1ca tempest-VolumesCloneTest-1117089562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:24 devstack sudo[87214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:39:24 devstack sudo[87214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:24 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a2135ddb-1349-46a5-8fc7-238b7fd78593 1073741824" returned: 0 in 1.689s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a2135ddb-1349-46a5-8fc7-238b7fd78593 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:25 devstack sudo[87220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a2135ddb-1349-46a5-8fc7-238b7fd78593 Apr 02 12:39:25 devstack sudo[87220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:25 devstack sudo[87214]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0173d081-a420-49ee-9bc6-5618361df1ca tempest-VolumesCloneTest-1117089562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.816s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:25 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-0173d081-a420-49ee-9bc6-5618361df1ca tempest-VolumesCloneTest-1117089562 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:39:25 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-0173d081-a420-49ee-9bc6-5618361df1ca tempest-VolumesCloneTest-1117089562 None] Deleted volume successfully. Apr 02 12:39:25 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0173d081-a420-49ee-9bc6-5618361df1ca tempest-VolumesCloneTest-1117089562 None] Lock "cinder-9f591b0f-eea6-4811-b68b-d4555cc3724d-delete_volume" released by "delete_volume" :: held 3.457s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:25 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e73167d8-b58e-4e94-bd66-f8b326047553 tempest-VolumesCloneTest-1117089562 None] Acquiring lock "cinder-d579e86e-d081-414a-bda7-241be00b2271-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:25 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e73167d8-b58e-4e94-bd66-f8b326047553 tempest-VolumesCloneTest-1117089562 None] Lock "cinder-d579e86e-d081-414a-bda7-241be00b2271-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:25 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e73167d8-b58e-4e94-bd66-f8b326047553 tempest-VolumesCloneTest-1117089562 None] Acquiring lock "cinder-quobyte-d579e86e-d081-414a-bda7-241be00b2271" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:25 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e73167d8-b58e-4e94-bd66-f8b326047553 tempest-VolumesCloneTest-1117089562 None] Lock "cinder-quobyte-d579e86e-d081-414a-bda7-241be00b2271" acquired by "delete_volume" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:25 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d100328d-d7f5-4fbd-939c-9fd37cbb8158]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:39:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e73167d8-b58e-4e94-bd66-f8b326047553 tempest-VolumesCloneTest-1117089562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:25 devstack sudo[87222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271 Apr 02 12:39:25 devstack sudo[87222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:25 devstack sudo[87220]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a2135ddb-1349-46a5-8fc7-238b7fd78593" returned: 0 in 0.992s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:25 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] <== create_volume: return (2738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:39:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.745s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-f614ad5f-53cb-490e-8a19-17d05c4d1cb0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.759s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:26 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7919f180-2277-4a11-949d-9d801928269e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2135ddb-1349-46a5-8fc7-238b7fd78593', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:26 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f516c7d7-613d-4ea7-be2a-e7d80321eb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:26 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-f614ad5f-53cb-490e-8a19-17d05c4d1cb0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Creating offline snapshot 4f7d4452-0709-45f8-b75c-1424362692fd of volume ddb799e9-dad5-42bb-a834-b1e22ba1a312 {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:39:26 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44898ca-69a4-4246-abf1-080ed906edaa]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:39:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f614ad5f-53cb-490e-8a19-17d05c4d1cb0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:26 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Volume volume-a2135ddb-1349-46a5-8fc7-238b7fd78593 (a2135ddb-1349-46a5-8fc7-238b7fd78593): created successfully Apr 02 12:39:26 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f516c7d7-613d-4ea7-be2a-e7d80321eb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:26 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Flow 'volume_create_manager' (da7a5884-dddd-45de-bc88-e07d2b4d621b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:39:26 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-70888654-920a-472f-9027-d9a5b883a3cb tempest-ServerRescueNegativeTestJSON-895119306 None] Created volume successfully. Apr 02 12:39:26 devstack sudo[87222]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e73167d8-b58e-4e94-bd66-f8b326047553 tempest-VolumesCloneTest-1117089562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271" returned: 0 in 0.646s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e73167d8-b58e-4e94-bd66-f8b326047553 tempest-VolumesCloneTest-1117089562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:26 devstack sudo[87229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271 Apr 02 12:39:26 devstack sudo[87229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:26 devstack sudo[87228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312 Apr 02 12:39:26 devstack sudo[87228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:26 devstack sudo[87229]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e73167d8-b58e-4e94-bd66-f8b326047553 tempest-VolumesCloneTest-1117089562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d579e86e-d081-414a-bda7-241be00b2271" returned: 0 in 0.664s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:26 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e73167d8-b58e-4e94-bd66-f8b326047553 tempest-VolumesCloneTest-1117089562 None] Lock "cinder-quobyte-d579e86e-d081-414a-bda7-241be00b2271" released by "delete_volume" :: held 1.381s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:26 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-e73167d8-b58e-4e94-bd66-f8b326047553 tempest-VolumesCloneTest-1117089562 None] Created reservations ['2a773dd1-bef4-4bc3-b591-b51b6257139f', 'c89627bb-6e84-4219-aaf9-d18663ff13f8', '6720c821-315b-450f-b525-e3ac5fd05394', '5d797d0a-a8e1-48ad-b1df-06f889312732'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:39:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e73167d8-b58e-4e94-bd66-f8b326047553 tempest-VolumesCloneTest-1117089562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e73167d8-b58e-4e94-bd66-f8b326047553 tempest-VolumesCloneTest-1117089562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:26 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e73167d8-b58e-4e94-bd66-f8b326047553 tempest-VolumesCloneTest-1117089562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:39:26 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e73167d8-b58e-4e94-bd66-f8b326047553 tempest-VolumesCloneTest-1117089562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:39:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e73167d8-b58e-4e94-bd66-f8b326047553 tempest-VolumesCloneTest-1117089562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e73167d8-b58e-4e94-bd66-f8b326047553 tempest-VolumesCloneTest-1117089562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:26 devstack sudo[87234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:39:26 devstack sudo[87234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:27 devstack sudo[87228]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f614ad5f-53cb-490e-8a19-17d05c4d1cb0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312" returned: 0 in 1.303s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f614ad5f-53cb-490e-8a19-17d05c4d1cb0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312.4f7d4452-0709-45f8-b75c-1424362692fd 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:27 devstack sudo[87239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312.4f7d4452-0709-45f8-b75c-1424362692fd 1G Apr 02 12:39:27 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:27 devstack sudo[87234]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e73167d8-b58e-4e94-bd66-f8b326047553 tempest-VolumesCloneTest-1117089562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.796s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:27 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-e73167d8-b58e-4e94-bd66-f8b326047553 tempest-VolumesCloneTest-1117089562 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:39:27 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-e73167d8-b58e-4e94-bd66-f8b326047553 tempest-VolumesCloneTest-1117089562 None] Deleted volume successfully. Apr 02 12:39:27 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e73167d8-b58e-4e94-bd66-f8b326047553 tempest-VolumesCloneTest-1117089562 None] Lock "cinder-d579e86e-d081-414a-bda7-241be00b2271-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:28 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:39:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Flow 'volume_create_manager' (4774f7bc-fb31-4adc-93a6-71ecd76f16c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:39:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4db0c8-67aa-454a-88ec-71f8cff8e2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4db0c8-67aa-454a-88ec-71f8cff8e2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-736188744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=290ccafc-f318-4146-b084-f2601dce0dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8fb0b611a24faabcfc752d9089f55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:39:28Z,use_quota=True,user_id='25df367707bb4769aea08a0faa930aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc0abf6-618c-4f91-a757-7f8362f959ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc0abf6-618c-4f91-a757-7f8362f959ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a34ac6f-1469-4e34-bf99-0260f4b83907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a34ac6f-1469-4e34-bf99-0260f4b83907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '290ccafc-f318-4146-b084-f2601dce0dfa', 'volume_name': 'volume-290ccafc-f318-4146-b084-f2601dce0dfa', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f70d891-9f14-425c-992b-ac0e352a660a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f70d891-9f14-425c-992b-ac0e352a660a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c5442a-47fe-4e4e-919b-bbe7480fc5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:28 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Volume 290ccafc-f318-4146-b084-f2601dce0dfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-290ccafc-f318-4146-b084-f2601dce0dfa', 'volume_size': 1} Apr 02 12:39:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:28 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f614ad5f-53cb-490e-8a19-17d05c4d1cb0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312.4f7d4452-0709-45f8-b75c-1424362692fd 1G" returned: 0 in 1.210s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f614ad5f-53cb-490e-8a19-17d05c4d1cb0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312.4f7d4452-0709-45f8-b75c-1424362692fd {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:28 devstack sudo[87246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312.4f7d4452-0709-45f8-b75c-1424362692fd Apr 02 12:39:28 devstack sudo[87246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:29 devstack sudo[87246]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f614ad5f-53cb-490e-8a19-17d05c4d1cb0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312.4f7d4452-0709-45f8-b75c-1424362692fd" returned: 0 in 0.619s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:29 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-f614ad5f-53cb-490e-8a19-17d05c4d1cb0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312.4f7d4452-0709-45f8-b75c-1424362692fd is being set with open permissions: ugo+rw Apr 02 12:39:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f614ad5f-53cb-490e-8a19-17d05c4d1cb0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312.4f7d4452-0709-45f8-b75c-1424362692fd {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:29 devstack sudo[87251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312.4f7d4452-0709-45f8-b75c-1424362692fd Apr 02 12:39:29 devstack sudo[87251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:29 devstack sudo[87251]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f614ad5f-53cb-490e-8a19-17d05c4d1cb0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312.4f7d4452-0709-45f8-b75c-1424362692fd" returned: 0 in 0.531s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f614ad5f-53cb-490e-8a19-17d05c4d1cb0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:29 devstack sudo[87254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312.info Apr 02 12:39:29 devstack sudo[87254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:30 devstack sudo[87254]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f614ad5f-53cb-490e-8a19-17d05c4d1cb0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312.info" returned: 0 in 0.436s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:30 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-f614ad5f-53cb-490e-8a19-17d05c4d1cb0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312.info is being set with open permissions: ugo+rw Apr 02 12:39:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f614ad5f-53cb-490e-8a19-17d05c4d1cb0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:30 devstack sudo[87257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312.info Apr 02 12:39:30 devstack sudo[87257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:30 devstack sudo[87257]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f614ad5f-53cb-490e-8a19-17d05c4d1cb0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312.info" returned: 0 in 0.427s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-f614ad5f-53cb-490e-8a19-17d05c4d1cb0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.651s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.131s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:30 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-736188744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=290ccafc-f318-4146-b084-f2601dce0dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8fb0b611a24faabcfc752d9089f55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:39:28Z,use_quota=True,user_id='25df367707bb4769aea08a0faa930aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:39:30 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Creating volume 290ccafc-f318-4146-b084-f2601dce0dfa {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:39:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:30 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:39:30 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:39:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:30 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:39:30 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:39:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-290ccafc-f318-4146-b084-f2601dce0dfa 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:30 devstack sudo[87260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-290ccafc-f318-4146-b084-f2601dce0dfa 1073741824 Apr 02 12:39:30 devstack sudo[87260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:30 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-f614ad5f-53cb-490e-8a19-17d05c4d1cb0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Create snapshot completed successfully Apr 02 12:39:31 devstack sudo[87260]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-290ccafc-f318-4146-b084-f2601dce0dfa 1073741824" returned: 0 in 0.671s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-290ccafc-f318-4146-b084-f2601dce0dfa {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:31 devstack sudo[87289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-290ccafc-f318-4146-b084-f2601dce0dfa Apr 02 12:39:31 devstack sudo[87289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:31 devstack sudo[87289]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-290ccafc-f318-4146-b084-f2601dce0dfa" returned: 0 in 0.499s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:31 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:39:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:31 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c5442a-47fe-4e4e-919b-bbe7480fc5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-290ccafc-f318-4146-b084-f2601dce0dfa', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:31 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5081ebe9-f9cf-43a1-99e3-0d1379241521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:31 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Volume volume-290ccafc-f318-4146-b084-f2601dce0dfa (290ccafc-f318-4146-b084-f2601dce0dfa): created successfully Apr 02 12:39:31 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5081ebe9-f9cf-43a1-99e3-0d1379241521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:31 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Flow 'volume_create_manager' (4774f7bc-fb31-4adc-93a6-71ecd76f16c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:39:31 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-9a2388ad-700a-4a88-9741-d3da22e8b3e3 tempest-VolumesTransfersV355Test-845348488 None] Created volume successfully. Apr 02 12:39:31 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:39:31 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Flow 'volume_create_manager' (919957ef-9cb2-48b7-86ad-f4325abaf129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:39:31 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8695e9c-68e1-43e3-8988-9b25264ccea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:31 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8695e9c-68e1-43e3-8988-9b25264ccea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2114523614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced20de9-52fc-41ba-a597-a04fb9525ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3223ba802de4b2aaf310bedafe91f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:39:32Z,use_quota=True,user_id='426084cf15bc496180d6d7badf012fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:31 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088b4eb7-f77e-4143-ac67-1ae1aff04c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088b4eb7-f77e-4143-ac67-1ae1aff04c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea9090c-2231-42bc-b432-a2093c9bc670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea9090c-2231-42bc-b432-a2093c9bc670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ced20de9-52fc-41ba-a597-a04fb9525ca1', 'volume_name': 'volume-ced20de9-52fc-41ba-a597-a04fb9525ca1', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab1a7afb-50ef-4c05-b940-527aabba9ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab1a7afb-50ef-4c05-b940-527aabba9ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a210c31-a720-4542-bbbb-6b30de325789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:32 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Volume ced20de9-52fc-41ba-a597-a04fb9525ca1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ced20de9-52fc-41ba-a597-a04fb9525ca1', 'volume_size': 1} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2114523614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced20de9-52fc-41ba-a597-a04fb9525ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3223ba802de4b2aaf310bedafe91f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:39:32Z,use_quota=True,user_id='426084cf15bc496180d6d7badf012fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Creating volume ced20de9-52fc-41ba-a597-a04fb9525ca1 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:39:32 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ced20de9-52fc-41ba-a597-a04fb9525ca1 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:32 devstack sudo[87293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ced20de9-52fc-41ba-a597-a04fb9525ca1 1073741824 Apr 02 12:39:32 devstack sudo[87293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Flow 'volume_create_manager' (9137edfc-04ed-4de2-b5f8-ec168840adae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9b8ae7-86de-4008-917f-fbff30546b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9b8ae7-86de-4008-917f-fbff30546b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1506636598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0bf2117-95b4-4810-a72e-ef1a001938fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3223ba802de4b2aaf310bedafe91f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:39:32Z,use_quota=True,user_id='426084cf15bc496180d6d7badf012fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe74faab-0fbd-41d2-8495-00144981a5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe74faab-0fbd-41d2-8495-00144981a5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d008d51d-aea6-429e-bb5d-80dd0220057d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d008d51d-aea6-429e-bb5d-80dd0220057d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0bf2117-95b4-4810-a72e-ef1a001938fc', 'volume_name': 'volume-b0bf2117-95b4-4810-a72e-ef1a001938fc', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca9f3932-ef86-44ff-8b5c-19788d4f8293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca9f3932-ef86-44ff-8b5c-19788d4f8293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99933231-c23e-4f57-94eb-03a05e161a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:32 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Volume b0bf2117-95b4-4810-a72e-ef1a001938fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0bf2117-95b4-4810-a72e-ef1a001938fc', 'volume_size': 1} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Flow 'volume_create_manager' (cfdba218-ec2c-4a57-8ce3-e7552ded2b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1dbbedf-c930-4f5c-a16d-2f6b2312c0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1dbbedf-c930-4f5c-a16d-2f6b2312c0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2075693196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=816e4218-a45d-4170-9667-aa964093f480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3223ba802de4b2aaf310bedafe91f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:39:33Z,use_quota=True,user_id='426084cf15bc496180d6d7badf012fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe584dd-b6b9-4d22-ab79-3c2878475083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe584dd-b6b9-4d22-ab79-3c2878475083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b7baa8-fca5-42a5-bc95-d297189aa4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b7baa8-fca5-42a5-bc95-d297189aa4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '816e4218-a45d-4170-9667-aa964093f480', 'volume_name': 'volume-816e4218-a45d-4170-9667-aa964093f480', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5b108b6-c32f-4e63-86c8-3872b89bf32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5b108b6-c32f-4e63-86c8-3872b89bf32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ddc6b6a-e12b-4d16-9c33-ae23dcd1fb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:32 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Volume 816e4218-a45d-4170-9667-aa964093f480: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-816e4218-a45d-4170-9667-aa964093f480', 'volume_size': 1} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:32 devstack sudo[87293]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ced20de9-52fc-41ba-a597-a04fb9525ca1 1073741824" returned: 0 in 0.816s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ced20de9-52fc-41ba-a597-a04fb9525ca1 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Flow 'volume_create_manager' (842fa587-2251-45f8-a5f5-6b3726c130c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d36bc2-b6da-419d-bee7-38b0299f8044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:32 devstack sudo[87304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ced20de9-52fc-41ba-a597-a04fb9525ca1 Apr 02 12:39:32 devstack sudo[87304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d36bc2-b6da-419d-bee7-38b0299f8044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1185624470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85aa52f3-edad-49f6-be78-3156b2e70cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3223ba802de4b2aaf310bedafe91f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:39:33Z,use_quota=True,user_id='426084cf15bc496180d6d7badf012fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b9f404d-7fd5-4ba2-be24-423b60b3d66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b9f404d-7fd5-4ba2-be24-423b60b3d66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21dcc409-8ac6-4188-86ac-33f2dc240570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21dcc409-8ac6-4188-86ac-33f2dc240570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85aa52f3-edad-49f6-be78-3156b2e70cf2', 'volume_name': 'volume-85aa52f3-edad-49f6-be78-3156b2e70cf2', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e28734e4-c3a6-48ba-988f-b5611d898ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e28734e4-c3a6-48ba-988f-b5611d898ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee905f4a-7680-476d-b49d-d2758b3c1098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:33 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Volume 85aa52f3-edad-49f6-be78-3156b2e70cf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85aa52f3-edad-49f6-be78-3156b2e70cf2', 'volume_size': 1} Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Flow 'volume_create_manager' (df94e52e-bb7f-4e97-80eb-1fb9a2fd1163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5508a9a-0e8d-48e6-848f-def23697cd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5508a9a-0e8d-48e6-848f-def23697cd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1076545105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07304517-1e5e-469a-bf4a-7195ca6b831d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3223ba802de4b2aaf310bedafe91f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:39:33Z,use_quota=True,user_id='426084cf15bc496180d6d7badf012fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6a4b4d-41ec-4b49-a961-6c708a211ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6a4b4d-41ec-4b49-a961-6c708a211ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a101c831-881a-4138-ad9a-c229e5171767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a101c831-881a-4138-ad9a-c229e5171767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07304517-1e5e-469a-bf4a-7195ca6b831d', 'volume_name': 'volume-07304517-1e5e-469a-bf4a-7195ca6b831d', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96cab1aa-a7a8-445c-bea4-a7a0ab8ed2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96cab1aa-a7a8-445c-bea4-a7a0ab8ed2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d8dd01-c56d-4546-8c78-1b0a8e610306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:33 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Volume 07304517-1e5e-469a-bf4a-7195ca6b831d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07304517-1e5e-469a-bf4a-7195ca6b831d', 'volume_size': 1} Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:33 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-402538f2-ab29-4820-9cee-9d1deb3a0d46 tempest-VolumesTransfersV355Test-1157759039 None] Transfer volume completed successfully. Apr 02 12:39:33 devstack sudo[87304]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ced20de9-52fc-41ba-a597-a04fb9525ca1" returned: 0 in 0.656s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.278s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1506636598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0bf2117-95b4-4810-a72e-ef1a001938fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3223ba802de4b2aaf310bedafe91f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:39:32Z,use_quota=True,user_id='426084cf15bc496180d6d7badf012fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Creating volume b0bf2117-95b4-4810-a72e-ef1a001938fc {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:39:33 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b0bf2117-95b4-4810-a72e-ef1a001938fc 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a210c31-a720-4542-bbbb-6b30de325789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ced20de9-52fc-41ba-a597-a04fb9525ca1', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:33 devstack sudo[87307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b0bf2117-95b4-4810-a72e-ef1a001938fc 1073741824 Apr 02 12:39:33 devstack sudo[87307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97bb4e5a-02ad-45f3-acf4-8415344f3b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:33 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Volume volume-ced20de9-52fc-41ba-a597-a04fb9525ca1 (ced20de9-52fc-41ba-a597-a04fb9525ca1): created successfully Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97bb4e5a-02ad-45f3-acf4-8415344f3b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Flow 'volume_create_manager' (919957ef-9cb2-48b7-86ad-f4325abaf129) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:39:33 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-aeae2a5c-f8fb-426d-86e6-bea73067dbe4 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Created volume successfully. Apr 02 12:39:34 devstack sudo[87307]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b0bf2117-95b4-4810-a72e-ef1a001938fc 1073741824" returned: 0 in 0.641s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b0bf2117-95b4-4810-a72e-ef1a001938fc {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:34 devstack sudo[87312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b0bf2117-95b4-4810-a72e-ef1a001938fc Apr 02 12:39:34 devstack sudo[87312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3ff3fd9f-9438-4a6e-970a-3956d4316321 tempest-VolumesTransfersV355Test-1612317559 None] Acquiring lock "cinder-290ccafc-f318-4146-b084-f2601dce0dfa-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3ff3fd9f-9438-4a6e-970a-3956d4316321 tempest-VolumesTransfersV355Test-1612317559 None] Lock "cinder-290ccafc-f318-4146-b084-f2601dce0dfa-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3ff3fd9f-9438-4a6e-970a-3956d4316321 tempest-VolumesTransfersV355Test-1612317559 None] Acquiring lock "cinder-quobyte-290ccafc-f318-4146-b084-f2601dce0dfa" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3ff3fd9f-9438-4a6e-970a-3956d4316321 tempest-VolumesTransfersV355Test-1612317559 None] Lock "cinder-quobyte-290ccafc-f318-4146-b084-f2601dce0dfa" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:34 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0a7fab-bda9-41be-9e0d-fb924abdb74a]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:39:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3ff3fd9f-9438-4a6e-970a-3956d4316321 tempest-VolumesTransfersV355Test-1612317559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-290ccafc-f318-4146-b084-f2601dce0dfa {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:34 devstack sudo[87314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-290ccafc-f318-4146-b084-f2601dce0dfa Apr 02 12:39:34 devstack sudo[87314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:34 devstack sudo[87312]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b0bf2117-95b4-4810-a72e-ef1a001938fc" returned: 0 in 0.489s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:39:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.907s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2075693196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=816e4218-a45d-4170-9667-aa964093f480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3223ba802de4b2aaf310bedafe91f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:39:33Z,use_quota=True,user_id='426084cf15bc496180d6d7badf012fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:39:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Creating volume 816e4218-a45d-4170-9667-aa964093f480 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:39:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:39:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:39:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:39:34 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:39:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-816e4218-a45d-4170-9667-aa964093f480 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99933231-c23e-4f57-94eb-03a05e161a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0bf2117-95b4-4810-a72e-ef1a001938fc', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:34 devstack sudo[87318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-816e4218-a45d-4170-9667-aa964093f480 1073741824 Apr 02 12:39:34 devstack sudo[87318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ce310e-850b-46e0-a32c-d911e518e607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:34 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Volume volume-b0bf2117-95b4-4810-a72e-ef1a001938fc (b0bf2117-95b4-4810-a72e-ef1a001938fc): created successfully Apr 02 12:39:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ce310e-850b-46e0-a32c-d911e518e607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Flow 'volume_create_manager' (9137edfc-04ed-4de2-b5f8-ec168840adae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:39:34 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-b855ab39-5ab6-4536-ac6d-085eb25e4651 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Created volume successfully. Apr 02 12:39:35 devstack sudo[87314]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3ff3fd9f-9438-4a6e-970a-3956d4316321 tempest-VolumesTransfersV355Test-1612317559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-290ccafc-f318-4146-b084-f2601dce0dfa" returned: 0 in 0.528s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3ff3fd9f-9438-4a6e-970a-3956d4316321 tempest-VolumesTransfersV355Test-1612317559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-290ccafc-f318-4146-b084-f2601dce0dfa {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:35 devstack sudo[87323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-290ccafc-f318-4146-b084-f2601dce0dfa Apr 02 12:39:35 devstack sudo[87323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:35 devstack sudo[87318]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-816e4218-a45d-4170-9667-aa964093f480 1073741824" returned: 0 in 0.572s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-816e4218-a45d-4170-9667-aa964093f480 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:35 devstack sudo[87328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-816e4218-a45d-4170-9667-aa964093f480 Apr 02 12:39:35 devstack sudo[87328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:35 devstack sudo[87323]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3ff3fd9f-9438-4a6e-970a-3956d4316321 tempest-VolumesTransfersV355Test-1612317559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-290ccafc-f318-4146-b084-f2601dce0dfa" returned: 0 in 0.487s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3ff3fd9f-9438-4a6e-970a-3956d4316321 tempest-VolumesTransfersV355Test-1612317559 None] Lock "cinder-quobyte-290ccafc-f318-4146-b084-f2601dce0dfa" released by "delete_volume" :: held 1.046s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-3ff3fd9f-9438-4a6e-970a-3956d4316321 tempest-VolumesTransfersV355Test-1612317559 None] Created reservations ['dae71c52-1a48-4106-a599-83b40f7cf24c', '2790abf4-8c7b-4674-8fdd-8c2ccc79eb8c', '7458d51e-6a95-4eca-ae25-7e2a59113d6a', 'ab44c38b-6e9f-4a00-9022-1f7318380f6f'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3ff3fd9f-9438-4a6e-970a-3956d4316321 tempest-VolumesTransfersV355Test-1612317559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3ff3fd9f-9438-4a6e-970a-3956d4316321 tempest-VolumesTransfersV355Test-1612317559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3ff3fd9f-9438-4a6e-970a-3956d4316321 tempest-VolumesTransfersV355Test-1612317559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3ff3fd9f-9438-4a6e-970a-3956d4316321 tempest-VolumesTransfersV355Test-1612317559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3ff3fd9f-9438-4a6e-970a-3956d4316321 tempest-VolumesTransfersV355Test-1612317559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3ff3fd9f-9438-4a6e-970a-3956d4316321 tempest-VolumesTransfersV355Test-1612317559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:35 devstack sudo[87331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:39:35 devstack sudo[87331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:35 devstack sudo[87328]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-816e4218-a45d-4170-9667-aa964093f480" returned: 0 in 0.467s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.802s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1185624470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85aa52f3-edad-49f6-be78-3156b2e70cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3223ba802de4b2aaf310bedafe91f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:39:33Z,use_quota=True,user_id='426084cf15bc496180d6d7badf012fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Creating volume 85aa52f3-edad-49f6-be78-3156b2e70cf2 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:39:35 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-85aa52f3-edad-49f6-be78-3156b2e70cf2 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ddc6b6a-e12b-4d16-9c33-ae23dcd1fb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-816e4218-a45d-4170-9667-aa964093f480', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:35 devstack sudo[87335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-85aa52f3-edad-49f6-be78-3156b2e70cf2 1073741824 Apr 02 12:39:35 devstack sudo[87335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2791ef5-fce7-4e5e-b5a2-6c5843568343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:35 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Volume volume-816e4218-a45d-4170-9667-aa964093f480 (816e4218-a45d-4170-9667-aa964093f480): created successfully Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2791ef5-fce7-4e5e-b5a2-6c5843568343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:35 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Flow 'volume_create_manager' (cfdba218-ec2c-4a57-8ce3-e7552ded2b43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:39:35 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-353fcc84-5b8f-4dd9-8d09-e1ad8ebad6c2 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Created volume successfully. Apr 02 12:39:36 devstack sudo[87331]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3ff3fd9f-9438-4a6e-970a-3956d4316321 tempest-VolumesTransfersV355Test-1612317559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.422s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:36 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-3ff3fd9f-9438-4a6e-970a-3956d4316321 tempest-VolumesTransfersV355Test-1612317559 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:39:36 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-3ff3fd9f-9438-4a6e-970a-3956d4316321 tempest-VolumesTransfersV355Test-1612317559 None] Deleted volume successfully. Apr 02 12:39:36 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3ff3fd9f-9438-4a6e-970a-3956d4316321 tempest-VolumesTransfersV355Test-1612317559 None] Lock "cinder-290ccafc-f318-4146-b084-f2601dce0dfa-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:36 devstack sudo[87335]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-85aa52f3-edad-49f6-be78-3156b2e70cf2 1073741824" returned: 0 in 0.866s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-85aa52f3-edad-49f6-be78-3156b2e70cf2 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:36 devstack sudo[87373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-85aa52f3-edad-49f6-be78-3156b2e70cf2 Apr 02 12:39:36 devstack sudo[87373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Flow 'volume_create_manager' (4c18d892-dbc3-47ca-8a9e-0508e241ed85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401a8a09-133a-4e0b-be9a-e3735e003d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401a8a09-133a-4e0b-be9a-e3735e003d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-423994088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e24dc0-b39d-401e-9d6d-d687c5d5193d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8fb0b611a24faabcfc752d9089f55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:39:37Z,use_quota=True,user_id='25df367707bb4769aea08a0faa930aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e8edaf-e037-4280-a664-764142c54142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e8edaf-e037-4280-a664-764142c54142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850a3103-b16a-4b1b-b8f8-6366394803c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850a3103-b16a-4b1b-b8f8-6366394803c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6e24dc0-b39d-401e-9d6d-d687c5d5193d', 'volume_name': 'volume-d6e24dc0-b39d-401e-9d6d-d687c5d5193d', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f6e4f7-4802-4970-b1ab-f7b1b38ba083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f6e4f7-4802-4970-b1ab-f7b1b38ba083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf06ab0-98c7-4bc9-9a59-a1a2e2b0265a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:37 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Volume d6e24dc0-b39d-401e-9d6d-d687c5d5193d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6e24dc0-b39d-401e-9d6d-d687c5d5193d', 'volume_size': 1} Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:37 devstack sudo[87373]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-85aa52f3-edad-49f6-be78-3156b2e70cf2" returned: 0 in 0.558s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.966s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1076545105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07304517-1e5e-469a-bf4a-7195ca6b831d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3223ba802de4b2aaf310bedafe91f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:39:33Z,use_quota=True,user_id='426084cf15bc496180d6d7badf012fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Creating volume 07304517-1e5e-469a-bf4a-7195ca6b831d {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:39:37 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-07304517-1e5e-469a-bf4a-7195ca6b831d 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee905f4a-7680-476d-b49d-d2758b3c1098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85aa52f3-edad-49f6-be78-3156b2e70cf2', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c43f41a-9506-487e-a789-517f01413776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:37 devstack sudo[87377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-07304517-1e5e-469a-bf4a-7195ca6b831d 1073741824 Apr 02 12:39:37 devstack sudo[87377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:37 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Volume volume-85aa52f3-edad-49f6-be78-3156b2e70cf2 (85aa52f3-edad-49f6-be78-3156b2e70cf2): created successfully Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c43f41a-9506-487e-a789-517f01413776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Flow 'volume_create_manager' (842fa587-2251-45f8-a5f5-6b3726c130c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:39:37 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-6fa8ea2d-5989-4ec4-9429-bab095d066ed tempest-CreateVolumesFromSnapshotTest-1233139760 None] Created volume successfully. Apr 02 12:39:38 devstack sudo[87377]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-07304517-1e5e-469a-bf4a-7195ca6b831d 1073741824" returned: 0 in 0.895s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-07304517-1e5e-469a-bf4a-7195ca6b831d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:38 devstack sudo[87384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-07304517-1e5e-469a-bf4a-7195ca6b831d Apr 02 12:39:38 devstack sudo[87384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:38 devstack sudo[87384]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-07304517-1e5e-469a-bf4a-7195ca6b831d" returned: 0 in 0.515s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:39:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.615s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-423994088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e24dc0-b39d-401e-9d6d-d687c5d5193d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8fb0b611a24faabcfc752d9089f55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:39:37Z,use_quota=True,user_id='25df367707bb4769aea08a0faa930aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:39:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Creating volume d6e24dc0-b39d-401e-9d6d-d687c5d5193d {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:39:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:39:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:39:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:39:38 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:39:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d6e24dc0-b39d-401e-9d6d-d687c5d5193d 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d8dd01-c56d-4546-8c78-1b0a8e610306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07304517-1e5e-469a-bf4a-7195ca6b831d', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:38 devstack sudo[87387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d6e24dc0-b39d-401e-9d6d-d687c5d5193d 1073741824 Apr 02 12:39:38 devstack sudo[87387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81500cd6-8477-4897-9b0e-46cdf70166fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:38 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Volume volume-07304517-1e5e-469a-bf4a-7195ca6b831d (07304517-1e5e-469a-bf4a-7195ca6b831d): created successfully Apr 02 12:39:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81500cd6-8477-4897-9b0e-46cdf70166fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Flow 'volume_create_manager' (df94e52e-bb7f-4e97-80eb-1fb9a2fd1163) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:39:38 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-41b7051c-a932-459c-8784-76b7e76d43c3 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Created volume successfully. Apr 02 12:39:39 devstack sudo[87387]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d6e24dc0-b39d-401e-9d6d-d687c5d5193d 1073741824" returned: 0 in 0.753s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d6e24dc0-b39d-401e-9d6d-d687c5d5193d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:39 devstack sudo[87393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d6e24dc0-b39d-401e-9d6d-d687c5d5193d Apr 02 12:39:39 devstack sudo[87393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:39 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3e967b56-feca-4640-8d76-727cd7c968bc tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "cinder-07304517-1e5e-469a-bf4a-7195ca6b831d-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:39 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3e967b56-feca-4640-8d76-727cd7c968bc tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-07304517-1e5e-469a-bf4a-7195ca6b831d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:40 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3e967b56-feca-4640-8d76-727cd7c968bc tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "cinder-quobyte-07304517-1e5e-469a-bf4a-7195ca6b831d" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:40 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3e967b56-feca-4640-8d76-727cd7c968bc tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-quobyte-07304517-1e5e-469a-bf4a-7195ca6b831d" acquired by "delete_volume" :: waited 0.025s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:40 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[603b0df4-d003-4692-bf43-d1b1fa35b3e8]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:39:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3e967b56-feca-4640-8d76-727cd7c968bc tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-07304517-1e5e-469a-bf4a-7195ca6b831d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:40 devstack sudo[87393]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d6e24dc0-b39d-401e-9d6d-d687c5d5193d" returned: 0 in 0.566s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:40 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] <== create_volume: return (1354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:39:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:40 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf06ab0-98c7-4bc9-9a59-a1a2e2b0265a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6e24dc0-b39d-401e-9d6d-d687c5d5193d', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:40 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40943cc8-c009-4dc8-bead-0b7f49b3e87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:40 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Volume volume-d6e24dc0-b39d-401e-9d6d-d687c5d5193d (d6e24dc0-b39d-401e-9d6d-d687c5d5193d): created successfully Apr 02 12:39:40 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40943cc8-c009-4dc8-bead-0b7f49b3e87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:40 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Flow 'volume_create_manager' (4c18d892-dbc3-47ca-8a9e-0508e241ed85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:39:40 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-670aa95e-72a8-4fd6-a9b4-2a82f8376854 tempest-VolumesTransfersV355Test-845348488 None] Created volume successfully. Apr 02 12:39:40 devstack sudo[87396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-07304517-1e5e-469a-bf4a-7195ca6b831d Apr 02 12:39:40 devstack sudo[87396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:40 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7c4a285c-ff5c-48ed-af65-3a48e716694d tempest-VolumesTransfersV355Test-1612317559 None] Acquiring lock "cinder-d6e24dc0-b39d-401e-9d6d-d687c5d5193d-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:40 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7c4a285c-ff5c-48ed-af65-3a48e716694d tempest-VolumesTransfersV355Test-1612317559 None] Lock "cinder-d6e24dc0-b39d-401e-9d6d-d687c5d5193d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:40 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7c4a285c-ff5c-48ed-af65-3a48e716694d tempest-VolumesTransfersV355Test-1612317559 None] Acquiring lock "cinder-quobyte-d6e24dc0-b39d-401e-9d6d-d687c5d5193d" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:40 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7c4a285c-ff5c-48ed-af65-3a48e716694d tempest-VolumesTransfersV355Test-1612317559 None] Lock "cinder-quobyte-d6e24dc0-b39d-401e-9d6d-d687c5d5193d" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:40 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d15effe-79f5-4d91-9a55-d878978cdc14]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:39:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7c4a285c-ff5c-48ed-af65-3a48e716694d tempest-VolumesTransfersV355Test-1612317559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d6e24dc0-b39d-401e-9d6d-d687c5d5193d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:40 devstack sudo[87396]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3e967b56-feca-4640-8d76-727cd7c968bc tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-07304517-1e5e-469a-bf4a-7195ca6b831d" returned: 0 in 0.785s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3e967b56-feca-4640-8d76-727cd7c968bc tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-07304517-1e5e-469a-bf4a-7195ca6b831d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:40 devstack sudo[87432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-07304517-1e5e-469a-bf4a-7195ca6b831d Apr 02 12:39:40 devstack sudo[87432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:40 devstack sudo[87431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d6e24dc0-b39d-401e-9d6d-d687c5d5193d Apr 02 12:39:40 devstack sudo[87431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:41 devstack sudo[87432]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3e967b56-feca-4640-8d76-727cd7c968bc tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-07304517-1e5e-469a-bf4a-7195ca6b831d" returned: 0 in 0.676s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:41 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3e967b56-feca-4640-8d76-727cd7c968bc tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-quobyte-07304517-1e5e-469a-bf4a-7195ca6b831d" released by "delete_volume" :: held 1.512s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:41 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-3e967b56-feca-4640-8d76-727cd7c968bc tempest-CreateVolumesFromSnapshotTest-1233139760 None] Created reservations ['6cf072e5-663b-4356-ae94-80dba4341050', '3a701e30-2c0f-452d-870c-589a9a152ab1', '61989a01-0d5c-420e-9506-ce2e24bb6414', '94d2fbc4-d0be-4cee-8577-98b28cea8630'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:39:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3e967b56-feca-4640-8d76-727cd7c968bc tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3e967b56-feca-4640-8d76-727cd7c968bc tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:41 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3e967b56-feca-4640-8d76-727cd7c968bc tempest-CreateVolumesFromSnapshotTest-1233139760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:39:41 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3e967b56-feca-4640-8d76-727cd7c968bc tempest-CreateVolumesFromSnapshotTest-1233139760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:39:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3e967b56-feca-4640-8d76-727cd7c968bc tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3e967b56-feca-4640-8d76-727cd7c968bc tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:41 devstack sudo[87473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:39:41 devstack sudo[87473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:41 devstack sudo[87431]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7c4a285c-ff5c-48ed-af65-3a48e716694d tempest-VolumesTransfersV355Test-1612317559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d6e24dc0-b39d-401e-9d6d-d687c5d5193d" returned: 0 in 1.001s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7c4a285c-ff5c-48ed-af65-3a48e716694d tempest-VolumesTransfersV355Test-1612317559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d6e24dc0-b39d-401e-9d6d-d687c5d5193d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:41 devstack sudo[87475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d6e24dc0-b39d-401e-9d6d-d687c5d5193d Apr 02 12:39:41 devstack sudo[87475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:42 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e7a3b704-29b1-4b0c-afbc-9d2c2ff41ea0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "cinder-85aa52f3-edad-49f6-be78-3156b2e70cf2-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:42 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e7a3b704-29b1-4b0c-afbc-9d2c2ff41ea0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-85aa52f3-edad-49f6-be78-3156b2e70cf2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:42 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e7a3b704-29b1-4b0c-afbc-9d2c2ff41ea0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "cinder-quobyte-85aa52f3-edad-49f6-be78-3156b2e70cf2" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:42 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e7a3b704-29b1-4b0c-afbc-9d2c2ff41ea0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-quobyte-85aa52f3-edad-49f6-be78-3156b2e70cf2" acquired by "delete_volume" :: waited 0.030s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:42 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ade3fd6c-4a4f-4c9d-aee7-8198b4ad6710 tempest-ServerRescueNegativeTestJSON-895119306 None] Acquiring lock "cinder-a2135ddb-1349-46a5-8fc7-238b7fd78593-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:42 devstack sudo[87475]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:42 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[24338f5b-3591-45d8-a7b6-68a0a86e5e09]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:39:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e7a3b704-29b1-4b0c-afbc-9d2c2ff41ea0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-85aa52f3-edad-49f6-be78-3156b2e70cf2 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7c4a285c-ff5c-48ed-af65-3a48e716694d tempest-VolumesTransfersV355Test-1612317559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d6e24dc0-b39d-401e-9d6d-d687c5d5193d" returned: 0 in 0.675s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:42 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ade3fd6c-4a4f-4c9d-aee7-8198b4ad6710 tempest-ServerRescueNegativeTestJSON-895119306 None] Lock "cinder-a2135ddb-1349-46a5-8fc7-238b7fd78593-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:42 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7c4a285c-ff5c-48ed-af65-3a48e716694d tempest-VolumesTransfersV355Test-1612317559 None] Lock "cinder-quobyte-d6e24dc0-b39d-401e-9d6d-d687c5d5193d" released by "delete_volume" :: held 1.743s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:42 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ade3fd6c-4a4f-4c9d-aee7-8198b4ad6710 tempest-ServerRescueNegativeTestJSON-895119306 None] Acquiring lock "cinder-quobyte-a2135ddb-1349-46a5-8fc7-238b7fd78593" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:42 devstack sudo[87494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-85aa52f3-edad-49f6-be78-3156b2e70cf2 Apr 02 12:39:42 devstack sudo[87494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:42 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ade3fd6c-4a4f-4c9d-aee7-8198b4ad6710 tempest-ServerRescueNegativeTestJSON-895119306 None] Lock "cinder-quobyte-a2135ddb-1349-46a5-8fc7-238b7fd78593" acquired by "delete_volume" :: waited 0.020s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:42 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df4375f-cf33-4fb2-b43b-a00d99a44497]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:39:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ade3fd6c-4a4f-4c9d-aee7-8198b4ad6710 tempest-ServerRescueNegativeTestJSON-895119306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a2135ddb-1349-46a5-8fc7-238b7fd78593 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:42 devstack sudo[87473]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3e967b56-feca-4640-8d76-727cd7c968bc tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.956s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:42 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-3e967b56-feca-4640-8d76-727cd7c968bc tempest-CreateVolumesFromSnapshotTest-1233139760 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:39:42 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-7c4a285c-ff5c-48ed-af65-3a48e716694d tempest-VolumesTransfersV355Test-1612317559 None] Created reservations ['fb1cb33b-fb99-493f-9373-89d88afcff55', '5b31e0b0-4b60-457f-ace6-a05d63836236', '4e4aef9d-f7e1-4789-be86-462f687bc481', '7a73bd9a-242f-4dec-b85d-0ee99b37618e'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:39:42 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-3e967b56-feca-4640-8d76-727cd7c968bc tempest-CreateVolumesFromSnapshotTest-1233139760 None] Deleted volume successfully. Apr 02 12:39:42 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3e967b56-feca-4640-8d76-727cd7c968bc tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-07304517-1e5e-469a-bf4a-7195ca6b831d-delete_volume" released by "delete_volume" :: held 2.818s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7c4a285c-ff5c-48ed-af65-3a48e716694d tempest-VolumesTransfersV355Test-1612317559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7c4a285c-ff5c-48ed-af65-3a48e716694d tempest-VolumesTransfersV355Test-1612317559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:42 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7c4a285c-ff5c-48ed-af65-3a48e716694d tempest-VolumesTransfersV355Test-1612317559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:39:42 devstack sudo[87497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a2135ddb-1349-46a5-8fc7-238b7fd78593 Apr 02 12:39:42 devstack sudo[87497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:42 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7c4a285c-ff5c-48ed-af65-3a48e716694d tempest-VolumesTransfersV355Test-1612317559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:39:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7c4a285c-ff5c-48ed-af65-3a48e716694d tempest-VolumesTransfersV355Test-1612317559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7c4a285c-ff5c-48ed-af65-3a48e716694d tempest-VolumesTransfersV355Test-1612317559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:42 devstack sudo[87499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:39:42 devstack sudo[87499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:43 devstack sudo[87494]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e7a3b704-29b1-4b0c-afbc-9d2c2ff41ea0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-85aa52f3-edad-49f6-be78-3156b2e70cf2" returned: 0 in 0.834s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e7a3b704-29b1-4b0c-afbc-9d2c2ff41ea0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-85aa52f3-edad-49f6-be78-3156b2e70cf2 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:43 devstack sudo[87504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-85aa52f3-edad-49f6-be78-3156b2e70cf2 Apr 02 12:39:43 devstack sudo[87504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:43 devstack sudo[87497]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ade3fd6c-4a4f-4c9d-aee7-8198b4ad6710 tempest-ServerRescueNegativeTestJSON-895119306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a2135ddb-1349-46a5-8fc7-238b7fd78593" returned: 0 in 0.925s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ade3fd6c-4a4f-4c9d-aee7-8198b4ad6710 tempest-ServerRescueNegativeTestJSON-895119306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a2135ddb-1349-46a5-8fc7-238b7fd78593 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:43 devstack sudo[87510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a2135ddb-1349-46a5-8fc7-238b7fd78593 Apr 02 12:39:43 devstack sudo[87510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:43 devstack sudo[87499]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7c4a285c-ff5c-48ed-af65-3a48e716694d tempest-VolumesTransfersV355Test-1612317559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.842s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:43 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-7c4a285c-ff5c-48ed-af65-3a48e716694d tempest-VolumesTransfersV355Test-1612317559 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:39:43 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-7c4a285c-ff5c-48ed-af65-3a48e716694d tempest-VolumesTransfersV355Test-1612317559 None] Deleted volume successfully. Apr 02 12:39:43 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7c4a285c-ff5c-48ed-af65-3a48e716694d tempest-VolumesTransfersV355Test-1612317559 None] Lock "cinder-d6e24dc0-b39d-401e-9d6d-d687c5d5193d-delete_volume" released by "delete_volume" :: held 3.025s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:44 devstack sudo[87510]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ade3fd6c-4a4f-4c9d-aee7-8198b4ad6710 tempest-ServerRescueNegativeTestJSON-895119306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a2135ddb-1349-46a5-8fc7-238b7fd78593" returned: 0 in 0.601s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ade3fd6c-4a4f-4c9d-aee7-8198b4ad6710 tempest-ServerRescueNegativeTestJSON-895119306 None] Lock "cinder-quobyte-a2135ddb-1349-46a5-8fc7-238b7fd78593" released by "delete_volume" :: held 1.607s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:44 devstack sudo[87504]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:44 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-ade3fd6c-4a4f-4c9d-aee7-8198b4ad6710 tempest-ServerRescueNegativeTestJSON-895119306 None] Created reservations ['d094dc85-3c4b-4bf6-9700-bde5a54ca78e', '7efe794e-334b-4cb9-ab36-96e3d35734ab', '31475862-e99a-47b7-b408-0b5072868c2a', 'e835940a-d925-4d00-ba43-198dc2ce1145'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:39:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e7a3b704-29b1-4b0c-afbc-9d2c2ff41ea0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-85aa52f3-edad-49f6-be78-3156b2e70cf2" returned: 0 in 0.948s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e7a3b704-29b1-4b0c-afbc-9d2c2ff41ea0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-quobyte-85aa52f3-edad-49f6-be78-3156b2e70cf2" released by "delete_volume" :: held 1.860s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ade3fd6c-4a4f-4c9d-aee7-8198b4ad6710 tempest-ServerRescueNegativeTestJSON-895119306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ade3fd6c-4a4f-4c9d-aee7-8198b4ad6710 tempest-ServerRescueNegativeTestJSON-895119306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:44 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ade3fd6c-4a4f-4c9d-aee7-8198b4ad6710 tempest-ServerRescueNegativeTestJSON-895119306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:39:44 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ade3fd6c-4a4f-4c9d-aee7-8198b4ad6710 tempest-ServerRescueNegativeTestJSON-895119306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:39:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ade3fd6c-4a4f-4c9d-aee7-8198b4ad6710 tempest-ServerRescueNegativeTestJSON-895119306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ade3fd6c-4a4f-4c9d-aee7-8198b4ad6710 tempest-ServerRescueNegativeTestJSON-895119306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:44 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-e7a3b704-29b1-4b0c-afbc-9d2c2ff41ea0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Created reservations ['ed12c1ce-78c9-45b1-9973-3d121f9e602a', 'b2c020c0-2376-45e8-b396-972eb34bbbf9', '95843c9e-719f-4609-8ed2-90287fcca3db', 'a84294af-cad3-4a80-b666-57ff0f40f577'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:39:44 devstack sudo[87514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:39:44 devstack sudo[87514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e7a3b704-29b1-4b0c-afbc-9d2c2ff41ea0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e7a3b704-29b1-4b0c-afbc-9d2c2ff41ea0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:44 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e7a3b704-29b1-4b0c-afbc-9d2c2ff41ea0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:39:44 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e7a3b704-29b1-4b0c-afbc-9d2c2ff41ea0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:39:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e7a3b704-29b1-4b0c-afbc-9d2c2ff41ea0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e7a3b704-29b1-4b0c-afbc-9d2c2ff41ea0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:44 devstack sudo[87516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:39:44 devstack sudo[87516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-24395f3a-7320-4637-a837-c9edc39635a6 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "cinder-816e4218-a45d-4170-9667-aa964093f480-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-24395f3a-7320-4637-a837-c9edc39635a6 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-816e4218-a45d-4170-9667-aa964093f480-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-24395f3a-7320-4637-a837-c9edc39635a6 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "cinder-quobyte-816e4218-a45d-4170-9667-aa964093f480" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-24395f3a-7320-4637-a837-c9edc39635a6 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-quobyte-816e4218-a45d-4170-9667-aa964093f480" acquired by "delete_volume" :: waited 0.033s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:44 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f942034c-d95e-4eee-9627-ead46d0b1525]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:39:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-24395f3a-7320-4637-a837-c9edc39635a6 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-816e4218-a45d-4170-9667-aa964093f480 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:45 devstack sudo[87519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-816e4218-a45d-4170-9667-aa964093f480 Apr 02 12:39:45 devstack sudo[87519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:45 devstack sudo[87514]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ade3fd6c-4a4f-4c9d-aee7-8198b4ad6710 tempest-ServerRescueNegativeTestJSON-895119306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.923s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:45 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-ade3fd6c-4a4f-4c9d-aee7-8198b4ad6710 tempest-ServerRescueNegativeTestJSON-895119306 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:39:45 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-ade3fd6c-4a4f-4c9d-aee7-8198b4ad6710 tempest-ServerRescueNegativeTestJSON-895119306 None] Deleted volume successfully. Apr 02 12:39:45 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ade3fd6c-4a4f-4c9d-aee7-8198b4ad6710 tempest-ServerRescueNegativeTestJSON-895119306 None] Lock "cinder-a2135ddb-1349-46a5-8fc7-238b7fd78593-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:45 devstack sudo[87516]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e7a3b704-29b1-4b0c-afbc-9d2c2ff41ea0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 1.228s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:45 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-e7a3b704-29b1-4b0c-afbc-9d2c2ff41ea0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:39:45 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-e7a3b704-29b1-4b0c-afbc-9d2c2ff41ea0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Deleted volume successfully. Apr 02 12:39:45 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e7a3b704-29b1-4b0c-afbc-9d2c2ff41ea0 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-85aa52f3-edad-49f6-be78-3156b2e70cf2-delete_volume" released by "delete_volume" :: held 3.438s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:45 devstack sudo[87519]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-24395f3a-7320-4637-a837-c9edc39635a6 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-816e4218-a45d-4170-9667-aa964093f480" returned: 0 in 0.860s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-24395f3a-7320-4637-a837-c9edc39635a6 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-816e4218-a45d-4170-9667-aa964093f480 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:45 devstack sudo[87526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-816e4218-a45d-4170-9667-aa964093f480 Apr 02 12:39:45 devstack sudo[87526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:46 devstack sudo[87526]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-24395f3a-7320-4637-a837-c9edc39635a6 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-816e4218-a45d-4170-9667-aa964093f480" returned: 0 in 0.572s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:46 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-24395f3a-7320-4637-a837-c9edc39635a6 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-quobyte-816e4218-a45d-4170-9667-aa964093f480" released by "delete_volume" :: held 1.510s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:46 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-24395f3a-7320-4637-a837-c9edc39635a6 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Created reservations ['e3f8005a-cca4-466b-a0f8-cb3e09c183c9', 'd6133d28-7bfc-44ed-b12a-6dfb9c31a43f', '7aab55fc-bbf8-41a2-a4cc-913c9a7c0e77', '968bd88e-c4b1-4de3-adc9-13b85b165044'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:39:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-24395f3a-7320-4637-a837-c9edc39635a6 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-24395f3a-7320-4637-a837-c9edc39635a6 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:46 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-24395f3a-7320-4637-a837-c9edc39635a6 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:39:46 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-24395f3a-7320-4637-a837-c9edc39635a6 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:39:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-24395f3a-7320-4637-a837-c9edc39635a6 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-24395f3a-7320-4637-a837-c9edc39635a6 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:46 devstack sudo[87556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:39:46 devstack sudo[87556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:47 devstack sudo[87556]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-24395f3a-7320-4637-a837-c9edc39635a6 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.508s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:47 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-24395f3a-7320-4637-a837-c9edc39635a6 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:39:47 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-24395f3a-7320-4637-a837-c9edc39635a6 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Deleted volume successfully. Apr 02 12:39:47 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-24395f3a-7320-4637-a837-c9edc39635a6 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-816e4218-a45d-4170-9667-aa964093f480-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:47 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b698d435-6e4d-4f93-a54d-c318fa061663 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "cinder-b0bf2117-95b4-4810-a72e-ef1a001938fc-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:47 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b698d435-6e4d-4f93-a54d-c318fa061663 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-b0bf2117-95b4-4810-a72e-ef1a001938fc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:47 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b698d435-6e4d-4f93-a54d-c318fa061663 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "cinder-quobyte-b0bf2117-95b4-4810-a72e-ef1a001938fc" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:47 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b698d435-6e4d-4f93-a54d-c318fa061663 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-quobyte-b0bf2117-95b4-4810-a72e-ef1a001938fc" acquired by "delete_volume" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:47 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae4e747-f9e3-4363-95e8-0829fa497b13]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:39:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b698d435-6e4d-4f93-a54d-c318fa061663 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b0bf2117-95b4-4810-a72e-ef1a001938fc {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:47 devstack sudo[87560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b0bf2117-95b4-4810-a72e-ef1a001938fc Apr 02 12:39:47 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:47 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b698d435-6e4d-4f93-a54d-c318fa061663 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b0bf2117-95b4-4810-a72e-ef1a001938fc" returned: 0 in 0.680s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b698d435-6e4d-4f93-a54d-c318fa061663 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b0bf2117-95b4-4810-a72e-ef1a001938fc {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:47 devstack sudo[87568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b0bf2117-95b4-4810-a72e-ef1a001938fc Apr 02 12:39:47 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:48 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b698d435-6e4d-4f93-a54d-c318fa061663 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b0bf2117-95b4-4810-a72e-ef1a001938fc" returned: 0 in 0.503s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:48 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b698d435-6e4d-4f93-a54d-c318fa061663 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-quobyte-b0bf2117-95b4-4810-a72e-ef1a001938fc" released by "delete_volume" :: held 1.215s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:48 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-b698d435-6e4d-4f93-a54d-c318fa061663 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Created reservations ['e4e6c20f-1d00-49d5-94c5-d7ae96b63118', '0822c610-bc77-4264-82e8-605b2c454efe', '6b62e526-6122-41b6-8947-935b93c436a9', '70ffb157-792e-4416-975f-b494ea49f53b'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:39:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b698d435-6e4d-4f93-a54d-c318fa061663 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b698d435-6e4d-4f93-a54d-c318fa061663 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:48 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b698d435-6e4d-4f93-a54d-c318fa061663 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:39:48 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b698d435-6e4d-4f93-a54d-c318fa061663 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:39:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b698d435-6e4d-4f93-a54d-c318fa061663 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b698d435-6e4d-4f93-a54d-c318fa061663 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:48 devstack sudo[87571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:39:48 devstack sudo[87571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:49 devstack sudo[87571]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b698d435-6e4d-4f93-a54d-c318fa061663 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.502s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:49 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-b698d435-6e4d-4f93-a54d-c318fa061663 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:39:49 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-b698d435-6e4d-4f93-a54d-c318fa061663 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Deleted volume successfully. Apr 02 12:39:49 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b698d435-6e4d-4f93-a54d-c318fa061663 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-b0bf2117-95b4-4810-a72e-ef1a001938fc-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:49 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c90078dd-44fa-4b3e-b49b-d74f90af2cda tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "cinder-ced20de9-52fc-41ba-a597-a04fb9525ca1-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:49 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c90078dd-44fa-4b3e-b49b-d74f90af2cda tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-ced20de9-52fc-41ba-a597-a04fb9525ca1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:49 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c90078dd-44fa-4b3e-b49b-d74f90af2cda tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "cinder-quobyte-ced20de9-52fc-41ba-a597-a04fb9525ca1" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:49 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c90078dd-44fa-4b3e-b49b-d74f90af2cda tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-quobyte-ced20de9-52fc-41ba-a597-a04fb9525ca1" acquired by "delete_volume" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:49 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e82fa9b-17e5-4e89-8256-1277f6d6f2d1]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:39:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c90078dd-44fa-4b3e-b49b-d74f90af2cda tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ced20de9-52fc-41ba-a597-a04fb9525ca1 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:49 devstack sudo[87574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ced20de9-52fc-41ba-a597-a04fb9525ca1 Apr 02 12:39:49 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:50 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c90078dd-44fa-4b3e-b49b-d74f90af2cda tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ced20de9-52fc-41ba-a597-a04fb9525ca1" returned: 0 in 0.585s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c90078dd-44fa-4b3e-b49b-d74f90af2cda tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ced20de9-52fc-41ba-a597-a04fb9525ca1 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:50 devstack sudo[87579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ced20de9-52fc-41ba-a597-a04fb9525ca1 Apr 02 12:39:50 devstack sudo[87579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Flow 'volume_create_manager' (a3d9dc28-e117-4981-a6d5-7533f36bc8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6db44e41-238e-4c4c-99b0-c6f2d52b43a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6db44e41-238e-4c4c-99b0-c6f2d52b43a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-558862203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307922b1-3d89-4d18-93c8-50c8f9b90362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c317242e34fd4641b57dcfb061e6a27a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:39:50Z,use_quota=True,user_id='2655333e7c13442aa8f6555372ec76df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f6faf3-4054-46e4-82a8-cfd46836608c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f6faf3-4054-46e4-82a8-cfd46836608c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1d2dd1-7c24-4338-b6aa-08269e80559b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1d2dd1-7c24-4338-b6aa-08269e80559b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '307922b1-3d89-4d18-93c8-50c8f9b90362', 'volume_name': 'volume-307922b1-3d89-4d18-93c8-50c8f9b90362', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6a7925-0aed-4161-90ca-c03fd883bc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6a7925-0aed-4161-90ca-c03fd883bc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f0cd608-6a02-4a88-8919-fd4ce076af4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:50 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Volume 307922b1-3d89-4d18-93c8-50c8f9b90362: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-307922b1-3d89-4d18-93c8-50c8f9b90362', 'volume_size': 1} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-558862203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307922b1-3d89-4d18-93c8-50c8f9b90362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c317242e34fd4641b57dcfb061e6a27a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:39:50Z,use_quota=True,user_id='2655333e7c13442aa8f6555372ec76df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Creating volume 307922b1-3d89-4d18-93c8-50c8f9b90362 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:39:50 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-307922b1-3d89-4d18-93c8-50c8f9b90362 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:50 devstack sudo[87581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-307922b1-3d89-4d18-93c8-50c8f9b90362 1073741824 Apr 02 12:39:50 devstack sudo[87581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:50 devstack sudo[87579]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c90078dd-44fa-4b3e-b49b-d74f90af2cda tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ced20de9-52fc-41ba-a597-a04fb9525ca1" returned: 0 in 0.473s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c90078dd-44fa-4b3e-b49b-d74f90af2cda tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-quobyte-ced20de9-52fc-41ba-a597-a04fb9525ca1" released by "delete_volume" :: held 1.088s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-c90078dd-44fa-4b3e-b49b-d74f90af2cda tempest-CreateVolumesFromSnapshotTest-1233139760 None] Created reservations ['f40db0f5-fa14-4039-8077-19b1b46fb76d', '9a7ed407-f059-4f92-8a31-ec84c870b025', 'f0d35cf6-fb6c-48f2-a198-03af62d53fc8', '64c3bbc7-11fc-4176-9572-78114eeafc9b'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c90078dd-44fa-4b3e-b49b-d74f90af2cda tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c90078dd-44fa-4b3e-b49b-d74f90af2cda tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c90078dd-44fa-4b3e-b49b-d74f90af2cda tempest-CreateVolumesFromSnapshotTest-1233139760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c90078dd-44fa-4b3e-b49b-d74f90af2cda tempest-CreateVolumesFromSnapshotTest-1233139760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c90078dd-44fa-4b3e-b49b-d74f90af2cda tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c90078dd-44fa-4b3e-b49b-d74f90af2cda tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:50 devstack sudo[87584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:39:50 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:50 devstack sudo[87581]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-307922b1-3d89-4d18-93c8-50c8f9b90362 1073741824" returned: 0 in 0.559s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-307922b1-3d89-4d18-93c8-50c8f9b90362 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:50 devstack sudo[87589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-307922b1-3d89-4d18-93c8-50c8f9b90362 Apr 02 12:39:50 devstack sudo[87589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:51 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c90078dd-44fa-4b3e-b49b-d74f90af2cda tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.497s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:51 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-c90078dd-44fa-4b3e-b49b-d74f90af2cda tempest-CreateVolumesFromSnapshotTest-1233139760 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:39:51 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-c90078dd-44fa-4b3e-b49b-d74f90af2cda tempest-CreateVolumesFromSnapshotTest-1233139760 None] Deleted volume successfully. Apr 02 12:39:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c90078dd-44fa-4b3e-b49b-d74f90af2cda tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-ced20de9-52fc-41ba-a597-a04fb9525ca1-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:51 devstack sudo[87589]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-307922b1-3d89-4d18-93c8-50c8f9b90362" returned: 0 in 0.541s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:51 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:39:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:51 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f0cd608-6a02-4a88-8919-fd4ce076af4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-307922b1-3d89-4d18-93c8-50c8f9b90362', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:51 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b07cbbd-adc5-4069-9ee2-489b72620eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:51 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Volume volume-307922b1-3d89-4d18-93c8-50c8f9b90362 (307922b1-3d89-4d18-93c8-50c8f9b90362): created successfully Apr 02 12:39:51 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b07cbbd-adc5-4069-9ee2-489b72620eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:51 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Flow 'volume_create_manager' (a3d9dc28-e117-4981-a6d5-7533f36bc8b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:39:51 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-50e3aa4f-582d-4b7b-ae95-ca68b7c772bf tempest-VolumesNegativeTest-1854614387 None] Created volume successfully. Apr 02 12:39:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1124379e-a621-4b78-8ad5-a6575ac492c7 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "cinder-4f7d4452-0709-45f8-b75c-1424362692fd-delete_snapshot" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1124379e-a621-4b78-8ad5-a6575ac492c7 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-4f7d4452-0709-45f8-b75c-1424362692fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1124379e-a621-4b78-8ad5-a6575ac492c7 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "cinder-quobyte-ddb799e9-dad5-42bb-a834-b1e22ba1a312" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1124379e-a621-4b78-8ad5-a6575ac492c7 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-quobyte-ddb799e9-dad5-42bb-a834-b1e22ba1a312" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1124379e-a621-4b78-8ad5-a6575ac492c7 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "cinder-quobyte-4f7d4452-0709-45f8-b75c-1424362692fd" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1124379e-a621-4b78-8ad5-a6575ac492c7 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-quobyte-4f7d4452-0709-45f8-b75c-1424362692fd" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:51 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-1124379e-a621-4b78-8ad5-a6575ac492c7 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Deleting offline snapshot 4f7d4452-0709-45f8-b75c-1424362692fd of volume ddb799e9-dad5-42bb-a834-b1e22ba1a312 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:39:51 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-1124379e-a621-4b78-8ad5-a6575ac492c7 tempest-CreateVolumesFromSnapshotTest-1233139760 None] snapshot_file for this snap is: volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312.4f7d4452-0709-45f8-b75c-1424362692fd {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:39:51 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6413d3f-ee3e-4be2-bbc4-6c20e3e31c90]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:39:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1124379e-a621-4b78-8ad5-a6575ac492c7 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312.4f7d4452-0709-45f8-b75c-1424362692fd {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:51 devstack sudo[87594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312.4f7d4452-0709-45f8-b75c-1424362692fd Apr 02 12:39:51 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:52 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1124379e-a621-4b78-8ad5-a6575ac492c7 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312.4f7d4452-0709-45f8-b75c-1424362692fd" returned: 0 in 0.476s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:52 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-1124379e-a621-4b78-8ad5-a6575ac492c7 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:39:52 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e623e6-e2af-4732-a166-772334953f33]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:39:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1124379e-a621-4b78-8ad5-a6575ac492c7 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:52 devstack sudo[87599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312 Apr 02 12:39:52 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:52 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1124379e-a621-4b78-8ad5-a6575ac492c7 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312" returned: 0 in 0.662s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1124379e-a621-4b78-8ad5-a6575ac492c7 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312.4f7d4452-0709-45f8-b75c-1424362692fd {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:52 devstack sudo[87631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312.4f7d4452-0709-45f8-b75c-1424362692fd Apr 02 12:39:52 devstack sudo[87631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:53 devstack sudo[87631]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1124379e-a621-4b78-8ad5-a6575ac492c7 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312.4f7d4452-0709-45f8-b75c-1424362692fd" returned: 0 in 0.529s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1124379e-a621-4b78-8ad5-a6575ac492c7 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312.4f7d4452-0709-45f8-b75c-1424362692fd {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:53 devstack sudo[87640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312.4f7d4452-0709-45f8-b75c-1424362692fd Apr 02 12:39:53 devstack sudo[87640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:53 devstack sudo[87640]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1124379e-a621-4b78-8ad5-a6575ac492c7 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312.4f7d4452-0709-45f8-b75c-1424362692fd" returned: 0 in 0.529s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:53 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1124379e-a621-4b78-8ad5-a6575ac492c7 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-quobyte-4f7d4452-0709-45f8-b75c-1424362692fd" released by "_delete_snapshot" :: held 2.275s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:53 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1124379e-a621-4b78-8ad5-a6575ac492c7 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-quobyte-ddb799e9-dad5-42bb-a834-b1e22ba1a312" released by "delete_snapshot" :: held 2.287s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:53 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:INSERT=44,cinder:UPDATE=161,cinder:DELETE=16,cinder:SELECT=113 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:39:53 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-1124379e-a621-4b78-8ad5-a6575ac492c7 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Created reservations ['64527f83-647a-4aa3-a847-6d0c5c2a1c58', '0b1f440d-9a4a-4b83-afde-c26a3ef81338', '50f8752e-fff7-419a-af5f-4158f16c7a9d', 'f09b393c-936a-40ae-992a-4f623bb58931'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:39:54 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-1124379e-a621-4b78-8ad5-a6575ac492c7 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Delete snapshot completed successfully. Apr 02 12:39:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1124379e-a621-4b78-8ad5-a6575ac492c7 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-4f7d4452-0709-45f8-b75c-1424362692fd-delete_snapshot" released by "delete_snapshot" :: held 2.436s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-871a43c5-47fa-4584-a51e-18e29b4a7704 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "cinder-ddb799e9-dad5-42bb-a834-b1e22ba1a312-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-871a43c5-47fa-4584-a51e-18e29b4a7704 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-ddb799e9-dad5-42bb-a834-b1e22ba1a312-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:54 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:SELECT=125,cinder:INSERT=40,cinder:UPDATE=169,cinder:DELETE=14 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:39:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-871a43c5-47fa-4584-a51e-18e29b4a7704 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "cinder-quobyte-ddb799e9-dad5-42bb-a834-b1e22ba1a312" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:39:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-871a43c5-47fa-4584-a51e-18e29b4a7704 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-quobyte-ddb799e9-dad5-42bb-a834-b1e22ba1a312" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:39:54 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[3239b22b-fd19-46b1-b8d0-814fabebf1e9]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:39:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-871a43c5-47fa-4584-a51e-18e29b4a7704 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:54 devstack sudo[87646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312 Apr 02 12:39:54 devstack sudo[87646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:55 devstack sudo[87646]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-871a43c5-47fa-4584-a51e-18e29b4a7704 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312" returned: 0 in 0.599s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-871a43c5-47fa-4584-a51e-18e29b4a7704 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:55 devstack sudo[87685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312 Apr 02 12:39:55 devstack sudo[87685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:55 devstack sudo[87685]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-871a43c5-47fa-4584-a51e-18e29b4a7704 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ddb799e9-dad5-42bb-a834-b1e22ba1a312" returned: 0 in 0.393s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:55 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-871a43c5-47fa-4584-a51e-18e29b4a7704 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-quobyte-ddb799e9-dad5-42bb-a834-b1e22ba1a312" released by "delete_volume" :: held 1.036s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:55 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-871a43c5-47fa-4584-a51e-18e29b4a7704 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Created reservations ['3b5a6cb2-ca7c-4aac-bac6-86de4730c416', 'd065dcd5-2692-4cf3-912f-313c66867f68', 'f8e8d311-f8c9-49fe-b5bc-578a52d0cb65', 'e902c2ca-469b-412b-82aa-f04481e78003'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:39:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-871a43c5-47fa-4584-a51e-18e29b4a7704 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-871a43c5-47fa-4584-a51e-18e29b4a7704 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:55 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-871a43c5-47fa-4584-a51e-18e29b4a7704 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:39:55 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-871a43c5-47fa-4584-a51e-18e29b4a7704 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:39:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-871a43c5-47fa-4584-a51e-18e29b4a7704 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-871a43c5-47fa-4584-a51e-18e29b4a7704 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:55 devstack sudo[87688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:39:56 devstack sudo[87688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:56 devstack sudo[87688]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-871a43c5-47fa-4584-a51e-18e29b4a7704 tempest-CreateVolumesFromSnapshotTest-1233139760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.427s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:56 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-871a43c5-47fa-4584-a51e-18e29b4a7704 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:39:56 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-871a43c5-47fa-4584-a51e-18e29b4a7704 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Deleted volume successfully. Apr 02 12:39:56 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-871a43c5-47fa-4584-a51e-18e29b4a7704 tempest-CreateVolumesFromSnapshotTest-1233139760 None] Lock "cinder-ddb799e9-dad5-42bb-a834-b1e22ba1a312-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:39:59 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:39:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Flow 'volume_create_manager' (c03343ae-907d-419d-9358-d6fe8d6a7675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:39:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8fbf68e-92b9-417d-ba17-0ed4c606919f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8fbf68e-92b9-417d-ba17-0ed4c606919f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-219068946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ca2f83d-daa8-4ba1-b96e-1c2eef75379e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf20e862ec44f24bdc5bdcd46d05167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:39:59Z,use_quota=True,user_id='166a84d3391046c192e85fa6d44446ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a250b1-ebdf-4920-93d0-da22a3b704bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a250b1-ebdf-4920-93d0-da22a3b704bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (532ee45a-9cd5-4a52-bd43-f9ae936a1e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (532ee45a-9cd5-4a52-bd43-f9ae936a1e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ca2f83d-daa8-4ba1-b96e-1c2eef75379e', 'volume_name': 'volume-5ca2f83d-daa8-4ba1-b96e-1c2eef75379e', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (380f192e-3258-4e5d-9a8a-8eca34e3caae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (380f192e-3258-4e5d-9a8a-8eca34e3caae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:39:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea36f701-11a8-43e8-8d08-b72009099f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:39:59 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Volume 5ca2f83d-daa8-4ba1-b96e-1c2eef75379e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ca2f83d-daa8-4ba1-b96e-1c2eef75379e', 'volume_size': 1} Apr 02 12:39:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:59 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-219068946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ca2f83d-daa8-4ba1-b96e-1c2eef75379e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf20e862ec44f24bdc5bdcd46d05167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:39:59Z,use_quota=True,user_id='166a84d3391046c192e85fa6d44446ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:39:59 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Creating volume 5ca2f83d-daa8-4ba1-b96e-1c2eef75379e {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:39:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:39:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:39:59 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:39:59 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:39:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:39:59 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:39:59 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:39:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5ca2f83d-daa8-4ba1-b96e-1c2eef75379e 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:59 devstack sudo[87693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5ca2f83d-daa8-4ba1-b96e-1c2eef75379e 1073741824 Apr 02 12:39:59 devstack sudo[87693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:39:59 devstack sudo[87693]: pam_unix(sudo:session): session closed for user root Apr 02 12:39:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5ca2f83d-daa8-4ba1-b96e-1c2eef75379e 1073741824" returned: 0 in 0.663s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:39:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5ca2f83d-daa8-4ba1-b96e-1c2eef75379e {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:39:59 devstack sudo[87714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5ca2f83d-daa8-4ba1-b96e-1c2eef75379e Apr 02 12:39:59 devstack sudo[87714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:00 devstack sudo[87714]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5ca2f83d-daa8-4ba1-b96e-1c2eef75379e" returned: 0 in 0.465s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:00 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:40:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea36f701-11a8-43e8-8d08-b72009099f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ca2f83d-daa8-4ba1-b96e-1c2eef75379e', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dfb4c0b-24d6-4d8a-9330-4a3437073c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:00 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Volume volume-5ca2f83d-daa8-4ba1-b96e-1c2eef75379e (5ca2f83d-daa8-4ba1-b96e-1c2eef75379e): created successfully Apr 02 12:40:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dfb4c0b-24d6-4d8a-9330-4a3437073c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Flow 'volume_create_manager' (c03343ae-907d-419d-9358-d6fe8d6a7675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:00 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-45014ceb-1b21-42f5-9969-23f117ac9fa3 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Created volume successfully. Apr 02 12:40:01 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:40:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Flow 'volume_create_manager' (edb61374-7997-44f6-bae9-ff9f448c724b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8cb106-5e71-45dd-97f4-1e9d56480328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8cb106-5e71-45dd-97f4-1e9d56480328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-861502300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a948b45-db25-4a71-b191-4b4238abcb0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf20e862ec44f24bdc5bdcd46d05167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:02Z,use_quota=True,user_id='166a84d3391046c192e85fa6d44446ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0709783d-1ed3-45df-9ff8-b250f9d095d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0709783d-1ed3-45df-9ff8-b250f9d095d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c1afba4-d6ed-4fbe-8445-18809b97a6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c1afba4-d6ed-4fbe-8445-18809b97a6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a948b45-db25-4a71-b191-4b4238abcb0c', 'volume_name': 'volume-0a948b45-db25-4a71-b191-4b4238abcb0c', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ef64d2-5d8d-4e97-ac0e-9b93083c3db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ef64d2-5d8d-4e97-ac0e-9b93083c3db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa79abe-eb84-4cd0-aaec-ac5387cda714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:01 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Volume 0a948b45-db25-4a71-b191-4b4238abcb0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a948b45-db25-4a71-b191-4b4238abcb0c', 'volume_size': 1} Apr 02 12:40:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:01 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-861502300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a948b45-db25-4a71-b191-4b4238abcb0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf20e862ec44f24bdc5bdcd46d05167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:02Z,use_quota=True,user_id='166a84d3391046c192e85fa6d44446ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:40:01 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Creating volume 0a948b45-db25-4a71-b191-4b4238abcb0c {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:40:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:01 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:01 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:01 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:40:01 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:40:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0a948b45-db25-4a71-b191-4b4238abcb0c 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:01 devstack sudo[87718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0a948b45-db25-4a71-b191-4b4238abcb0c 1073741824 Apr 02 12:40:01 devstack sudo[87718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:01 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Flow 'volume_create_manager' (9d7ce87e-b9f7-4578-8800-e9a1612fdaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa643f17-b9b0-4184-9b39-587b7dd5fa1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa643f17-b9b0-4184-9b39-587b7dd5fa1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1940281510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=606aa5bd-e9bf-4c61-add1-907e88a99b6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf20e862ec44f24bdc5bdcd46d05167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:02Z,use_quota=True,user_id='166a84d3391046c192e85fa6d44446ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb47cb8c-2b31-48c8-a807-8d8fb997d665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb47cb8c-2b31-48c8-a807-8d8fb997d665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a998d36-b23b-484f-9056-87101eef8f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a998d36-b23b-484f-9056-87101eef8f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '606aa5bd-e9bf-4c61-add1-907e88a99b6c', 'volume_name': 'volume-606aa5bd-e9bf-4c61-add1-907e88a99b6c', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48fe9e85-ce76-48c0-b1eb-7a2328e2ba2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48fe9e85-ce76-48c0-b1eb-7a2328e2ba2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf4a9f34-d2cc-412d-b539-80c94cae46e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:02 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Volume 606aa5bd-e9bf-4c61-add1-907e88a99b6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-606aa5bd-e9bf-4c61-add1-907e88a99b6c', 'volume_size': 1} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Flow 'volume_create_manager' (40fdf119-c83b-4ce5-8224-3b34bc570a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (691b4e14-029d-4623-9b82-d8deed254c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (691b4e14-029d-4623-9b82-d8deed254c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1718895119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35701ebc-452d-4273-99d3-098e2e66accf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf20e862ec44f24bdc5bdcd46d05167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:02Z,use_quota=True,user_id='166a84d3391046c192e85fa6d44446ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e3ca0bc-4d49-4da8-81ae-b916939aeec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e3ca0bc-4d49-4da8-81ae-b916939aeec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (065d7bf5-65a4-47ad-a4c6-239f8a74cd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (065d7bf5-65a4-47ad-a4c6-239f8a74cd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35701ebc-452d-4273-99d3-098e2e66accf', 'volume_name': 'volume-35701ebc-452d-4273-99d3-098e2e66accf', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a683a75a-217a-4c5b-81c6-d6b265f63ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a683a75a-217a-4c5b-81c6-d6b265f63ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee25da41-bc1b-44db-ad55-dc7543c06837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:02 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Volume 35701ebc-452d-4273-99d3-098e2e66accf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35701ebc-452d-4273-99d3-098e2e66accf', 'volume_size': 1} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Flow 'volume_create_manager' (f52c0cab-33cb-4ca7-9024-f02cdbf82651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1137266-5d63-4857-b991-fb7e6478e154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:02 devstack sudo[87718]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1137266-5d63-4857-b991-fb7e6478e154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2023876033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2fe6f19-4561-4cda-a503-c782960ac16f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf20e862ec44f24bdc5bdcd46d05167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:03Z,use_quota=True,user_id='166a84d3391046c192e85fa6d44446ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9953de4f-55da-468e-8eac-e9ade8321792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9953de4f-55da-468e-8eac-e9ade8321792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3da953-9547-49d2-a186-413f73fca828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3da953-9547-49d2-a186-413f73fca828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2fe6f19-4561-4cda-a503-c782960ac16f', 'volume_name': 'volume-c2fe6f19-4561-4cda-a503-c782960ac16f', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b66d23c-96e8-4963-b279-219bfaab4d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b66d23c-96e8-4963-b279-219bfaab4d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9937b37-9960-40e3-a20b-96430c6210e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:02 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Volume c2fe6f19-4561-4cda-a503-c782960ac16f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2fe6f19-4561-4cda-a503-c782960ac16f', 'volume_size': 1} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0a948b45-db25-4a71-b191-4b4238abcb0c 1073741824" returned: 0 in 0.836s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0a948b45-db25-4a71-b191-4b4238abcb0c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:02 devstack sudo[87724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0a948b45-db25-4a71-b191-4b4238abcb0c Apr 02 12:40:02 devstack sudo[87724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Flow 'volume_create_manager' (2e6c307e-1c4d-4473-80e2-1c7c96b9e1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f115160-cda5-4e37-a84c-6cce9ade07f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f115160-cda5-4e37-a84c-6cce9ade07f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1322668041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e71303-ab66-4b72-866c-e35e1ad2d124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf20e862ec44f24bdc5bdcd46d05167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:03Z,use_quota=True,user_id='166a84d3391046c192e85fa6d44446ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e831536-b18d-48a6-a2d8-4aec8ba7cb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e831536-b18d-48a6-a2d8-4aec8ba7cb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a874304-5a87-4308-a572-fea6d6897a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a874304-5a87-4308-a572-fea6d6897a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2e71303-ab66-4b72-866c-e35e1ad2d124', 'volume_name': 'volume-a2e71303-ab66-4b72-866c-e35e1ad2d124', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b3e0ee-868f-4b94-aac3-f17fbccb274d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b3e0ee-868f-4b94-aac3-f17fbccb274d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c71bad1-f62f-4e4d-9698-180840b53a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:02 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Volume a2e71303-ab66-4b72-866c-e35e1ad2d124: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2e71303-ab66-4b72-866c-e35e1ad2d124', 'volume_size': 1} Apr 02 12:40:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:03 devstack sudo[87724]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0a948b45-db25-4a71-b191-4b4238abcb0c" returned: 0 in 0.471s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:03 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:40:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.077s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:03 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1940281510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=606aa5bd-e9bf-4c61-add1-907e88a99b6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf20e862ec44f24bdc5bdcd46d05167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:02Z,use_quota=True,user_id='166a84d3391046c192e85fa6d44446ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:40:03 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Creating volume 606aa5bd-e9bf-4c61-add1-907e88a99b6c {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:40:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:03 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:03 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:03 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:40:03 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:40:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-606aa5bd-e9bf-4c61-add1-907e88a99b6c 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:03 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa79abe-eb84-4cd0-aaec-ac5387cda714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a948b45-db25-4a71-b191-4b4238abcb0c', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:03 devstack sudo[87730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-606aa5bd-e9bf-4c61-add1-907e88a99b6c 1073741824 Apr 02 12:40:03 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1968b085-b0e8-4826-843d-3284cb4771d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:03 devstack sudo[87730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:03 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Volume volume-0a948b45-db25-4a71-b191-4b4238abcb0c (0a948b45-db25-4a71-b191-4b4238abcb0c): created successfully Apr 02 12:40:03 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1968b085-b0e8-4826-843d-3284cb4771d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:03 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Flow 'volume_create_manager' (edb61374-7997-44f6-bae9-ff9f448c724b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:03 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-6e563dc3-0b1a-4d72-b121-5e3e16c7be75 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Created volume successfully. Apr 02 12:40:03 devstack sudo[87730]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-606aa5bd-e9bf-4c61-add1-907e88a99b6c 1073741824" returned: 0 in 0.535s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-606aa5bd-e9bf-4c61-add1-907e88a99b6c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:03 devstack sudo[87735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-606aa5bd-e9bf-4c61-add1-907e88a99b6c Apr 02 12:40:03 devstack sudo[87735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:04 devstack sudo[87735]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-606aa5bd-e9bf-4c61-add1-907e88a99b6c" returned: 0 in 0.478s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.825s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1718895119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35701ebc-452d-4273-99d3-098e2e66accf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf20e862ec44f24bdc5bdcd46d05167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:02Z,use_quota=True,user_id='166a84d3391046c192e85fa6d44446ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Creating volume 35701ebc-452d-4273-99d3-098e2e66accf {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:40:04 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-35701ebc-452d-4273-99d3-098e2e66accf 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf4a9f34-d2cc-412d-b539-80c94cae46e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-606aa5bd-e9bf-4c61-add1-907e88a99b6c', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbf311bb-285d-4519-8a32-f3ff74d5bb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:04 devstack sudo[87738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-35701ebc-452d-4273-99d3-098e2e66accf 1073741824 Apr 02 12:40:04 devstack sudo[87738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:04 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Volume volume-606aa5bd-e9bf-4c61-add1-907e88a99b6c (606aa5bd-e9bf-4c61-add1-907e88a99b6c): created successfully Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbf311bb-285d-4519-8a32-f3ff74d5bb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Flow 'volume_create_manager' (9d7ce87e-b9f7-4578-8800-e9a1612fdaaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:04 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-d3ca5f20-2e19-4078-927c-b3f8f3fd0722 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Created volume successfully. Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Flow 'volume_create_manager' (f1db7628-93fc-4e2a-81b6-1339f750c6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (726b5078-b75d-4d12-84b3-e65710e8d249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (726b5078-b75d-4d12-84b3-e65710e8d249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1549783644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a7a753-22a9-43f4-93f1-e0635c2c57a5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='71baa870a20c4082a17a459d357e0171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:05Z,use_quota=True,user_id='b729de380b6247ffae4b7adb907c5605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b792e2e6-f1f4-47c7-9697-249eff9e63b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b792e2e6-f1f4-47c7-9697-249eff9e63b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee2425c-5d0b-4d43-93ca-d829d43f41a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee2425c-5d0b-4d43-93ca-d829d43f41a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4a7a753-22a9-43f4-93f1-e0635c2c57a5', 'volume_name': 'volume-a4a7a753-22a9-43f4-93f1-e0635c2c57a5', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c79b74-42a5-4eca-8d3f-2680bd5d81bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c79b74-42a5-4eca-8d3f-2680bd5d81bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97195baf-ee15-4059-92bf-d1423a2b1418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:04 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Volume a4a7a753-22a9-43f4-93f1-e0635c2c57a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4a7a753-22a9-43f4-93f1-e0635c2c57a5', 'volume_size': 1} Apr 02 12:40:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:05 devstack sudo[87738]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-35701ebc-452d-4273-99d3-098e2e66accf 1073741824" returned: 0 in 0.842s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-35701ebc-452d-4273-99d3-098e2e66accf {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:05 devstack sudo[87771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-35701ebc-452d-4273-99d3-098e2e66accf Apr 02 12:40:05 devstack sudo[87771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:05 devstack sudo[87771]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-35701ebc-452d-4273-99d3-098e2e66accf" returned: 0 in 0.427s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:05 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:40:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.862s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:05 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2023876033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2fe6f19-4561-4cda-a503-c782960ac16f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf20e862ec44f24bdc5bdcd46d05167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:03Z,use_quota=True,user_id='166a84d3391046c192e85fa6d44446ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:40:05 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Creating volume c2fe6f19-4561-4cda-a503-c782960ac16f {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:40:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:05 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:05 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:05 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:40:05 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:40:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c2fe6f19-4561-4cda-a503-c782960ac16f 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:05 devstack sudo[87774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c2fe6f19-4561-4cda-a503-c782960ac16f 1073741824 Apr 02 12:40:05 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee25da41-bc1b-44db-ad55-dc7543c06837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35701ebc-452d-4273-99d3-098e2e66accf', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b973f88-fc4a-4ef9-bc38-885e0d4cea8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:05 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Volume volume-35701ebc-452d-4273-99d3-098e2e66accf (35701ebc-452d-4273-99d3-098e2e66accf): created successfully Apr 02 12:40:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b973f88-fc4a-4ef9-bc38-885e0d4cea8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Flow 'volume_create_manager' (40fdf119-c83b-4ce5-8224-3b34bc570a68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:05 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-884b468b-8f77-43a5-a1cc-dfc2573a23d7 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Created volume successfully. Apr 02 12:40:06 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c2fe6f19-4561-4cda-a503-c782960ac16f 1073741824" returned: 0 in 0.533s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c2fe6f19-4561-4cda-a503-c782960ac16f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:06 devstack sudo[87779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c2fe6f19-4561-4cda-a503-c782960ac16f Apr 02 12:40:06 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:06 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c2fe6f19-4561-4cda-a503-c782960ac16f" returned: 0 in 0.423s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:06 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:40:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.594s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:06 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1322668041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e71303-ab66-4b72-866c-e35e1ad2d124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf20e862ec44f24bdc5bdcd46d05167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:03Z,use_quota=True,user_id='166a84d3391046c192e85fa6d44446ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:40:06 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Creating volume a2e71303-ab66-4b72-866c-e35e1ad2d124 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:40:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:06 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:06 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:06 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:40:06 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:40:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a2e71303-ab66-4b72-866c-e35e1ad2d124 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:06 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9937b37-9960-40e3-a20b-96430c6210e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2fe6f19-4561-4cda-a503-c782960ac16f', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:06 devstack sudo[87782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a2e71303-ab66-4b72-866c-e35e1ad2d124 1073741824 Apr 02 12:40:06 devstack sudo[87782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:06 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d351ea5-a1a0-4e2e-8701-eadc12fb4623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:06 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Volume volume-c2fe6f19-4561-4cda-a503-c782960ac16f (c2fe6f19-4561-4cda-a503-c782960ac16f): created successfully Apr 02 12:40:06 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d351ea5-a1a0-4e2e-8701-eadc12fb4623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:06 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Flow 'volume_create_manager' (f52c0cab-33cb-4ca7-9024-f02cdbf82651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:06 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-0c755997-f7ca-4471-862b-f158e243acdf tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Created volume successfully. Apr 02 12:40:07 devstack sudo[87782]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a2e71303-ab66-4b72-866c-e35e1ad2d124 1073741824" returned: 0 in 0.528s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a2e71303-ab66-4b72-866c-e35e1ad2d124 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:07 devstack sudo[87787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a2e71303-ab66-4b72-866c-e35e1ad2d124 Apr 02 12:40:07 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:07 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a2e71303-ab66-4b72-866c-e35e1ad2d124" returned: 0 in 0.460s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:07 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:40:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.852s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:07 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1549783644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a7a753-22a9-43f4-93f1-e0635c2c57a5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='71baa870a20c4082a17a459d357e0171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:05Z,use_quota=True,user_id='b729de380b6247ffae4b7adb907c5605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:40:07 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Creating volume a4a7a753-22a9-43f4-93f1-e0635c2c57a5 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:40:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:07 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:07 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:07 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:40:07 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:40:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a4a7a753-22a9-43f4-93f1-e0635c2c57a5 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:07 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c71bad1-f62f-4e4d-9698-180840b53a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2e71303-ab66-4b72-866c-e35e1ad2d124', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:07 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead3503f-f6c0-4c28-8571-7f2cbbaf67de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:07 devstack sudo[87792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a4a7a753-22a9-43f4-93f1-e0635c2c57a5 1073741824 Apr 02 12:40:07 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:07 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Volume volume-a2e71303-ab66-4b72-866c-e35e1ad2d124 (a2e71303-ab66-4b72-866c-e35e1ad2d124): created successfully Apr 02 12:40:07 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead3503f-f6c0-4c28-8571-7f2cbbaf67de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:07 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Flow 'volume_create_manager' (2e6c307e-1c4d-4473-80e2-1c7c96b9e1d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:07 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-34a0911d-edfd-4fdf-9723-7c87f6d159ba tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Created volume successfully. Apr 02 12:40:08 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a4a7a753-22a9-43f4-93f1-e0635c2c57a5 1073741824" returned: 0 in 0.517s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a4a7a753-22a9-43f4-93f1-e0635c2c57a5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:08 devstack sudo[87797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a4a7a753-22a9-43f4-93f1-e0635c2c57a5 Apr 02 12:40:08 devstack sudo[87797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:08 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7c601f91-0c17-4a62-a3eb-863f08a45c28 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "cinder-a2e71303-ab66-4b72-866c-e35e1ad2d124-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:08 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7c601f91-0c17-4a62-a3eb-863f08a45c28 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "cinder-a2e71303-ab66-4b72-866c-e35e1ad2d124-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:08 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7c601f91-0c17-4a62-a3eb-863f08a45c28 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "cinder-quobyte-a2e71303-ab66-4b72-866c-e35e1ad2d124" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:08 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7c601f91-0c17-4a62-a3eb-863f08a45c28 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "cinder-quobyte-a2e71303-ab66-4b72-866c-e35e1ad2d124" acquired by "delete_volume" :: waited 0.019s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:08 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dff0ece-0f21-4125-9593-e80f8a2ec469]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7c601f91-0c17-4a62-a3eb-863f08a45c28 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a2e71303-ab66-4b72-866c-e35e1ad2d124 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:08 devstack sudo[87828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a2e71303-ab66-4b72-866c-e35e1ad2d124 Apr 02 12:40:08 devstack sudo[87828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:08 devstack sudo[87797]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a4a7a753-22a9-43f4-93f1-e0635c2c57a5" returned: 0 in 0.543s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:08 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:40:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:08 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97195baf-ee15-4059-92bf-d1423a2b1418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4a7a753-22a9-43f4-93f1-e0635c2c57a5', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:08 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c9f3e8c-51ca-4f8b-b420-474874015a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:08 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Volume volume-a4a7a753-22a9-43f4-93f1-e0635c2c57a5 (a4a7a753-22a9-43f4-93f1-e0635c2c57a5): created successfully Apr 02 12:40:08 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c9f3e8c-51ca-4f8b-b420-474874015a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:08 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Flow 'volume_create_manager' (f1db7628-93fc-4e2a-81b6-1339f750c6af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:08 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-9c356218-34dc-4ba5-9e9f-7b5c25677767 tempest-VolumesTestJSON-829222027 None] Created volume successfully. Apr 02 12:40:09 devstack sudo[87828]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7c601f91-0c17-4a62-a3eb-863f08a45c28 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a2e71303-ab66-4b72-866c-e35e1ad2d124" returned: 0 in 0.592s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7c601f91-0c17-4a62-a3eb-863f08a45c28 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a2e71303-ab66-4b72-866c-e35e1ad2d124 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:09 devstack sudo[87836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a2e71303-ab66-4b72-866c-e35e1ad2d124 Apr 02 12:40:09 devstack sudo[87836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Flow 'volume_create_manager' (a7e2db45-5970-431f-9ff4-56cc6a495a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (331d3286-cb56-4bf1-a257-715794bd0b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (331d3286-cb56-4bf1-a257-715794bd0b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-875223960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a9eafd2-d37f-4a85-836e-753e080c7ec4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='71baa870a20c4082a17a459d357e0171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:09Z,use_quota=True,user_id='b729de380b6247ffae4b7adb907c5605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d36a6a2-f0ef-495e-9744-d53e1a0bda65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d36a6a2-f0ef-495e-9744-d53e1a0bda65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0589ee-f2ab-4866-b704-a6830ff9bf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0589ee-f2ab-4866-b704-a6830ff9bf05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a9eafd2-d37f-4a85-836e-753e080c7ec4', 'volume_name': 'volume-5a9eafd2-d37f-4a85-836e-753e080c7ec4', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44cb0b80-699c-4d3e-bcab-da5161da0fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44cb0b80-699c-4d3e-bcab-da5161da0fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08fcd7b7-bcf7-428d-b01a-02992d9b3178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:09 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Volume 5a9eafd2-d37f-4a85-836e-753e080c7ec4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a9eafd2-d37f-4a85-836e-753e080c7ec4', 'volume_size': 1} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-875223960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a9eafd2-d37f-4a85-836e-753e080c7ec4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='71baa870a20c4082a17a459d357e0171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:09Z,use_quota=True,user_id='b729de380b6247ffae4b7adb907c5605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Creating volume 5a9eafd2-d37f-4a85-836e-753e080c7ec4 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:40:09 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5a9eafd2-d37f-4a85-836e-753e080c7ec4 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:09 devstack sudo[87838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5a9eafd2-d37f-4a85-836e-753e080c7ec4 1073741824 Apr 02 12:40:09 devstack sudo[87838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:09 devstack sudo[87836]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7c601f91-0c17-4a62-a3eb-863f08a45c28 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a2e71303-ab66-4b72-866c-e35e1ad2d124" returned: 0 in 0.440s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7c601f91-0c17-4a62-a3eb-863f08a45c28 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "cinder-quobyte-a2e71303-ab66-4b72-866c-e35e1ad2d124" released by "delete_volume" :: held 1.063s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-7c601f91-0c17-4a62-a3eb-863f08a45c28 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Created reservations ['98080b54-0283-4c39-afda-3253c12c4348', '50cd4891-968e-453c-b888-306688e94b4b', 'e10d6847-27d5-46d1-a24e-57fec92af238', 'e3769694-1ee3-4ac8-a754-80801377afab'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7c601f91-0c17-4a62-a3eb-863f08a45c28 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7c601f91-0c17-4a62-a3eb-863f08a45c28 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7c601f91-0c17-4a62-a3eb-863f08a45c28 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7c601f91-0c17-4a62-a3eb-863f08a45c28 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7c601f91-0c17-4a62-a3eb-863f08a45c28 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7c601f91-0c17-4a62-a3eb-863f08a45c28 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:09 devstack sudo[87842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:40:09 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:09 devstack sudo[87838]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5a9eafd2-d37f-4a85-836e-753e080c7ec4 1073741824" returned: 0 in 0.523s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5a9eafd2-d37f-4a85-836e-753e080c7ec4 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:09 devstack sudo[87847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5a9eafd2-d37f-4a85-836e-753e080c7ec4 Apr 02 12:40:09 devstack sudo[87847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:10 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7c601f91-0c17-4a62-a3eb-863f08a45c28 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.430s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:10 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-7c601f91-0c17-4a62-a3eb-863f08a45c28 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:40:10 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-7c601f91-0c17-4a62-a3eb-863f08a45c28 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Deleted volume successfully. Apr 02 12:40:10 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7c601f91-0c17-4a62-a3eb-863f08a45c28 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "cinder-a2e71303-ab66-4b72-866c-e35e1ad2d124-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:10 devstack sudo[87847]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5a9eafd2-d37f-4a85-836e-753e080c7ec4" returned: 0 in 0.449s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:10 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:40:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:10 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08fcd7b7-bcf7-428d-b01a-02992d9b3178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a9eafd2-d37f-4a85-836e-753e080c7ec4', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:10 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38cc48b1-c7da-46d4-8b43-c7257b2dc1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:10 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Volume volume-5a9eafd2-d37f-4a85-836e-753e080c7ec4 (5a9eafd2-d37f-4a85-836e-753e080c7ec4): created successfully Apr 02 12:40:10 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38cc48b1-c7da-46d4-8b43-c7257b2dc1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:10 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Flow 'volume_create_manager' (a7e2db45-5970-431f-9ff4-56cc6a495a05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:10 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-7a0e180e-476c-406d-8949-195245ab1cc6 tempest-VolumesTestJSON-829222027 None] Created volume successfully. Apr 02 12:40:10 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d631b8c7-707e-4524-881f-09b9b848e887 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "cinder-c2fe6f19-4561-4cda-a503-c782960ac16f-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:10 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d631b8c7-707e-4524-881f-09b9b848e887 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "cinder-c2fe6f19-4561-4cda-a503-c782960ac16f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:10 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d631b8c7-707e-4524-881f-09b9b848e887 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "cinder-quobyte-c2fe6f19-4561-4cda-a503-c782960ac16f" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:10 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d631b8c7-707e-4524-881f-09b9b848e887 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "cinder-quobyte-c2fe6f19-4561-4cda-a503-c782960ac16f" acquired by "delete_volume" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:10 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a95d4c-c704-4c23-8daa-a10a058e96b1]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d631b8c7-707e-4524-881f-09b9b848e887 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c2fe6f19-4561-4cda-a503-c782960ac16f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:10 devstack sudo[87852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c2fe6f19-4561-4cda-a503-c782960ac16f Apr 02 12:40:10 devstack sudo[87852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:11 devstack sudo[87852]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d631b8c7-707e-4524-881f-09b9b848e887 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c2fe6f19-4561-4cda-a503-c782960ac16f" returned: 0 in 0.451s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d631b8c7-707e-4524-881f-09b9b848e887 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c2fe6f19-4561-4cda-a503-c782960ac16f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:11 devstack sudo[87857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c2fe6f19-4561-4cda-a503-c782960ac16f Apr 02 12:40:11 devstack sudo[87857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Flow 'volume_create_manager' (1f5be607-2639-4bfa-b3ca-3746870cbbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3863570-16de-4464-9607-be810deba7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3863570-16de-4464-9607-be810deba7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-176895532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b9c594c-7719-41e2-9814-996f645499ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='71baa870a20c4082a17a459d357e0171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:12Z,use_quota=True,user_id='b729de380b6247ffae4b7adb907c5605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a0398d-eac4-4882-b3ba-bf5b45bd133b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a0398d-eac4-4882-b3ba-bf5b45bd133b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6260514-6f0a-4104-8338-dcc82a1b056a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6260514-6f0a-4104-8338-dcc82a1b056a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b9c594c-7719-41e2-9814-996f645499ab', 'volume_name': 'volume-7b9c594c-7719-41e2-9814-996f645499ab', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2829ce4f-b6fb-4856-87d5-830fe6ad9d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2829ce4f-b6fb-4856-87d5-830fe6ad9d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b31c8d0f-6cbd-4595-b045-70f0d71c2d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:11 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Volume 7b9c594c-7719-41e2-9814-996f645499ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b9c594c-7719-41e2-9814-996f645499ab', 'volume_size': 1} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-176895532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b9c594c-7719-41e2-9814-996f645499ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='71baa870a20c4082a17a459d357e0171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:12Z,use_quota=True,user_id='b729de380b6247ffae4b7adb907c5605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Creating volume 7b9c594c-7719-41e2-9814-996f645499ab {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:40:11 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7b9c594c-7719-41e2-9814-996f645499ab 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:11 devstack sudo[87857]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d631b8c7-707e-4524-881f-09b9b848e887 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c2fe6f19-4561-4cda-a503-c782960ac16f" returned: 0 in 0.476s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:11 devstack sudo[87860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7b9c594c-7719-41e2-9814-996f645499ab 1073741824 Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d631b8c7-707e-4524-881f-09b9b848e887 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "cinder-quobyte-c2fe6f19-4561-4cda-a503-c782960ac16f" released by "delete_volume" :: held 0.951s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:11 devstack sudo[87860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-d631b8c7-707e-4524-881f-09b9b848e887 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Created reservations ['388b98d4-26a2-4cda-b019-7831e7aec73a', 'a4eedd83-dd1e-4f36-9826-369c4251aaae', 'd81b3b09-ef5f-4527-a1b5-af8e6a42a961', 'cff3b319-30da-4c9a-97f3-ab0eaad51255'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d631b8c7-707e-4524-881f-09b9b848e887 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d631b8c7-707e-4524-881f-09b9b848e887 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-d631b8c7-707e-4524-881f-09b9b848e887 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-d631b8c7-707e-4524-881f-09b9b848e887 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d631b8c7-707e-4524-881f-09b9b848e887 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d631b8c7-707e-4524-881f-09b9b848e887 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:11 devstack sudo[87862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:40:11 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-34f05cab-42ed-4383-8804-418f62b8d816 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "cinder-35701ebc-452d-4273-99d3-098e2e66accf-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-34f05cab-42ed-4383-8804-418f62b8d816 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "cinder-35701ebc-452d-4273-99d3-098e2e66accf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-34f05cab-42ed-4383-8804-418f62b8d816 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "cinder-quobyte-35701ebc-452d-4273-99d3-098e2e66accf" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-34f05cab-42ed-4383-8804-418f62b8d816 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "cinder-quobyte-35701ebc-452d-4273-99d3-098e2e66accf" acquired by "delete_volume" :: waited 0.007s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e0bf78-073c-4020-b71f-7f112c7bdf5a]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-34f05cab-42ed-4383-8804-418f62b8d816 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-35701ebc-452d-4273-99d3-098e2e66accf {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:12 devstack sudo[87864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-35701ebc-452d-4273-99d3-098e2e66accf Apr 02 12:40:12 devstack sudo[87864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:12 devstack sudo[87860]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7b9c594c-7719-41e2-9814-996f645499ab 1073741824" returned: 0 in 0.557s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:12 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d631b8c7-707e-4524-881f-09b9b848e887 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.478s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:12 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-d631b8c7-707e-4524-881f-09b9b848e887 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:40:12 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-d631b8c7-707e-4524-881f-09b9b848e887 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Deleted volume successfully. Apr 02 12:40:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7b9c594c-7719-41e2-9814-996f645499ab {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:12 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d631b8c7-707e-4524-881f-09b9b848e887 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "cinder-c2fe6f19-4561-4cda-a503-c782960ac16f-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:12 devstack sudo[87870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7b9c594c-7719-41e2-9814-996f645499ab Apr 02 12:40:12 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:12 devstack sudo[87864]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-34f05cab-42ed-4383-8804-418f62b8d816 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-35701ebc-452d-4273-99d3-098e2e66accf" returned: 0 in 0.511s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-34f05cab-42ed-4383-8804-418f62b8d816 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-35701ebc-452d-4273-99d3-098e2e66accf {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:12 devstack sudo[87875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-35701ebc-452d-4273-99d3-098e2e66accf Apr 02 12:40:12 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:12 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7b9c594c-7719-41e2-9814-996f645499ab" returned: 0 in 0.439s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:12 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:40:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:12 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b31c8d0f-6cbd-4595-b045-70f0d71c2d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b9c594c-7719-41e2-9814-996f645499ab', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:12 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d04bd13e-988e-4cc4-b1c2-528347a58953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:12 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Volume volume-7b9c594c-7719-41e2-9814-996f645499ab (7b9c594c-7719-41e2-9814-996f645499ab): created successfully Apr 02 12:40:12 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d04bd13e-988e-4cc4-b1c2-528347a58953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:12 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Flow 'volume_create_manager' (1f5be607-2639-4bfa-b3ca-3746870cbbe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:12 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-36c72d45-830c-48ff-b9d6-6cd282e30c51 tempest-VolumesTestJSON-829222027 None] Created volume successfully. Apr 02 12:40:12 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-34f05cab-42ed-4383-8804-418f62b8d816 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-35701ebc-452d-4273-99d3-098e2e66accf" returned: 0 in 0.436s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:12 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-34f05cab-42ed-4383-8804-418f62b8d816 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "cinder-quobyte-35701ebc-452d-4273-99d3-098e2e66accf" released by "delete_volume" :: held 0.967s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:12 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-34f05cab-42ed-4383-8804-418f62b8d816 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Created reservations ['bc48ce3c-3cae-4cfb-bb8e-9d914005a049', '809fdc30-c313-4e72-b013-9bc128aab78c', '37ab3aed-04a3-4e76-829e-f13b5ec31804', '0109a6e8-5bd0-4c42-b413-c6d554e6aff2'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:40:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-34f05cab-42ed-4383-8804-418f62b8d816 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-34f05cab-42ed-4383-8804-418f62b8d816 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:12 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-34f05cab-42ed-4383-8804-418f62b8d816 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:12 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-34f05cab-42ed-4383-8804-418f62b8d816 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-34f05cab-42ed-4383-8804-418f62b8d816 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-34f05cab-42ed-4383-8804-418f62b8d816 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:12 devstack sudo[87879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:40:12 devstack sudo[87879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:13 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2c5842f7-f244-4d2d-b9da-65dcf9d3eae2 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "cinder-606aa5bd-e9bf-4c61-add1-907e88a99b6c-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:13 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2c5842f7-f244-4d2d-b9da-65dcf9d3eae2 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "cinder-606aa5bd-e9bf-4c61-add1-907e88a99b6c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:13 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2c5842f7-f244-4d2d-b9da-65dcf9d3eae2 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "cinder-quobyte-606aa5bd-e9bf-4c61-add1-907e88a99b6c" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:13 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2c5842f7-f244-4d2d-b9da-65dcf9d3eae2 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "cinder-quobyte-606aa5bd-e9bf-4c61-add1-907e88a99b6c" acquired by "delete_volume" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:13 devstack cinder-volume[82819]: DEBUG oslo_service.periodic_task [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82819) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 12:40:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:13 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0a57a9-b013-4ff7-a6e5-ddeacd5497f8]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2c5842f7-f244-4d2d-b9da-65dcf9d3eae2 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-606aa5bd-e9bf-4c61-add1-907e88a99b6c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:13 devstack sudo[87881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:40:13 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:13 devstack sudo[87883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-606aa5bd-e9bf-4c61-add1-907e88a99b6c Apr 02 12:40:13 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:13 devstack sudo[87879]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-34f05cab-42ed-4383-8804-418f62b8d816 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.464s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:13 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-34f05cab-42ed-4383-8804-418f62b8d816 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:40:13 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-34f05cab-42ed-4383-8804-418f62b8d816 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Deleted volume successfully. Apr 02 12:40:13 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-34f05cab-42ed-4383-8804-418f62b8d816 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "cinder-35701ebc-452d-4273-99d3-098e2e66accf-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:13 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.443s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:13 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:40:13 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2c5842f7-f244-4d2d-b9da-65dcf9d3eae2 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-606aa5bd-e9bf-4c61-add1-907e88a99b6c" returned: 0 in 0.523s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2c5842f7-f244-4d2d-b9da-65dcf9d3eae2 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-606aa5bd-e9bf-4c61-add1-907e88a99b6c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:13 devstack sudo[87890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-606aa5bd-e9bf-4c61-add1-907e88a99b6c Apr 02 12:40:13 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:14 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2c5842f7-f244-4d2d-b9da-65dcf9d3eae2 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-606aa5bd-e9bf-4c61-add1-907e88a99b6c" returned: 0 in 0.432s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:14 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2c5842f7-f244-4d2d-b9da-65dcf9d3eae2 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "cinder-quobyte-606aa5bd-e9bf-4c61-add1-907e88a99b6c" released by "delete_volume" :: held 0.997s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:14 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-2c5842f7-f244-4d2d-b9da-65dcf9d3eae2 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Created reservations ['f10f3e25-4913-43a0-8766-6efc3b8b5e08', '5e515182-cbdc-4c5e-a682-46d84c74b4c7', '1d2e8313-d457-4f8e-b9bb-ee1017fccdd5', '76b0ee2b-53e5-4fa4-8d1c-5aed12ae009b'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:40:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2c5842f7-f244-4d2d-b9da-65dcf9d3eae2 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2c5842f7-f244-4d2d-b9da-65dcf9d3eae2 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:14 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2c5842f7-f244-4d2d-b9da-65dcf9d3eae2 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:14 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2c5842f7-f244-4d2d-b9da-65dcf9d3eae2 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2c5842f7-f244-4d2d-b9da-65dcf9d3eae2 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2c5842f7-f244-4d2d-b9da-65dcf9d3eae2 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:14 devstack sudo[87893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:40:14 devstack sudo[87893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:14 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6010f018-621a-46ac-9f22-88722b147696 tempest-VolumesTestJSON-829222027 None] Acquiring lock "cinder-7b9c594c-7719-41e2-9814-996f645499ab-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:14 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6010f018-621a-46ac-9f22-88722b147696 tempest-VolumesTestJSON-829222027 None] Lock "cinder-7b9c594c-7719-41e2-9814-996f645499ab-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:14 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6010f018-621a-46ac-9f22-88722b147696 tempest-VolumesTestJSON-829222027 None] Acquiring lock "cinder-quobyte-7b9c594c-7719-41e2-9814-996f645499ab" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:14 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6010f018-621a-46ac-9f22-88722b147696 tempest-VolumesTestJSON-829222027 None] Lock "cinder-quobyte-7b9c594c-7719-41e2-9814-996f645499ab" acquired by "delete_volume" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:14 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05f68ad-25a1-4216-b132-4abb229b7260]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6010f018-621a-46ac-9f22-88722b147696 tempest-VolumesTestJSON-829222027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7b9c594c-7719-41e2-9814-996f645499ab {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:14 devstack sudo[87895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7b9c594c-7719-41e2-9814-996f645499ab Apr 02 12:40:14 devstack sudo[87895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:14 devstack sudo[87893]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2c5842f7-f244-4d2d-b9da-65dcf9d3eae2 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.517s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:14 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-2c5842f7-f244-4d2d-b9da-65dcf9d3eae2 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:40:14 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-2c5842f7-f244-4d2d-b9da-65dcf9d3eae2 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Deleted volume successfully. Apr 02 12:40:14 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2c5842f7-f244-4d2d-b9da-65dcf9d3eae2 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "cinder-606aa5bd-e9bf-4c61-add1-907e88a99b6c-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:14 devstack sudo[87895]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6010f018-621a-46ac-9f22-88722b147696 tempest-VolumesTestJSON-829222027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7b9c594c-7719-41e2-9814-996f645499ab" returned: 0 in 0.500s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6010f018-621a-46ac-9f22-88722b147696 tempest-VolumesTestJSON-829222027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7b9c594c-7719-41e2-9814-996f645499ab {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:15 devstack sudo[87901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7b9c594c-7719-41e2-9814-996f645499ab Apr 02 12:40:15 devstack sudo[87901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:15 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0e30c4f4-8f4e-4d74-8da0-50bddfeaaf00 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "cinder-0a948b45-db25-4a71-b191-4b4238abcb0c-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:15 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0e30c4f4-8f4e-4d74-8da0-50bddfeaaf00 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "cinder-0a948b45-db25-4a71-b191-4b4238abcb0c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:15 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0e30c4f4-8f4e-4d74-8da0-50bddfeaaf00 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "cinder-quobyte-0a948b45-db25-4a71-b191-4b4238abcb0c" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:15 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0e30c4f4-8f4e-4d74-8da0-50bddfeaaf00 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "cinder-quobyte-0a948b45-db25-4a71-b191-4b4238abcb0c" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:15 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[23639ed1-e4b3-4700-b2d7-0f57ee0f4c8f]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0e30c4f4-8f4e-4d74-8da0-50bddfeaaf00 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0a948b45-db25-4a71-b191-4b4238abcb0c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:15 devstack sudo[87903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0a948b45-db25-4a71-b191-4b4238abcb0c Apr 02 12:40:15 devstack sudo[87903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:15 devstack sudo[87901]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6010f018-621a-46ac-9f22-88722b147696 tempest-VolumesTestJSON-829222027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7b9c594c-7719-41e2-9814-996f645499ab" returned: 0 in 0.449s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:15 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6010f018-621a-46ac-9f22-88722b147696 tempest-VolumesTestJSON-829222027 None] Lock "cinder-quobyte-7b9c594c-7719-41e2-9814-996f645499ab" released by "delete_volume" :: held 0.986s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:15 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-6010f018-621a-46ac-9f22-88722b147696 tempest-VolumesTestJSON-829222027 None] Created reservations ['ead9f0a2-c90d-42bb-bc8e-91521b2999f7', 'fdd5aed5-3bff-4e53-b914-f6376afd39ff', '303710d0-f023-4763-af11-550d9daaf234', '65c7fa71-88fc-424f-af74-0ad473ea2a3b'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:40:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6010f018-621a-46ac-9f22-88722b147696 tempest-VolumesTestJSON-829222027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6010f018-621a-46ac-9f22-88722b147696 tempest-VolumesTestJSON-829222027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:15 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6010f018-621a-46ac-9f22-88722b147696 tempest-VolumesTestJSON-829222027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:15 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6010f018-621a-46ac-9f22-88722b147696 tempest-VolumesTestJSON-829222027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6010f018-621a-46ac-9f22-88722b147696 tempest-VolumesTestJSON-829222027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6010f018-621a-46ac-9f22-88722b147696 tempest-VolumesTestJSON-829222027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:15 devstack sudo[87906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:40:15 devstack sudo[87906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:15 devstack sudo[87903]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0e30c4f4-8f4e-4d74-8da0-50bddfeaaf00 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0a948b45-db25-4a71-b191-4b4238abcb0c" returned: 0 in 0.516s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0e30c4f4-8f4e-4d74-8da0-50bddfeaaf00 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0a948b45-db25-4a71-b191-4b4238abcb0c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:15 devstack sudo[87911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0a948b45-db25-4a71-b191-4b4238abcb0c Apr 02 12:40:15 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:15 devstack sudo[87906]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6010f018-621a-46ac-9f22-88722b147696 tempest-VolumesTestJSON-829222027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.446s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:15 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-6010f018-621a-46ac-9f22-88722b147696 tempest-VolumesTestJSON-829222027 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:40:16 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-6010f018-621a-46ac-9f22-88722b147696 tempest-VolumesTestJSON-829222027 None] Deleted volume successfully. Apr 02 12:40:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6010f018-621a-46ac-9f22-88722b147696 tempest-VolumesTestJSON-829222027 None] Lock "cinder-7b9c594c-7719-41e2-9814-996f645499ab-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:16 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0e30c4f4-8f4e-4d74-8da0-50bddfeaaf00 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0a948b45-db25-4a71-b191-4b4238abcb0c" returned: 0 in 0.452s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0e30c4f4-8f4e-4d74-8da0-50bddfeaaf00 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "cinder-quobyte-0a948b45-db25-4a71-b191-4b4238abcb0c" released by "delete_volume" :: held 0.997s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:16 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-0e30c4f4-8f4e-4d74-8da0-50bddfeaaf00 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Created reservations ['e11052c2-1579-4535-8b71-53bbf475556d', '63f91c4f-2514-4f21-91e3-8722295256aa', '824d8917-c421-4b4b-9dcd-0cc8c54cf8f7', '5dff976b-64ad-4359-97d7-d0401db0085c'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:40:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0e30c4f4-8f4e-4d74-8da0-50bddfeaaf00 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0e30c4f4-8f4e-4d74-8da0-50bddfeaaf00 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:16 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-0e30c4f4-8f4e-4d74-8da0-50bddfeaaf00 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:16 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-0e30c4f4-8f4e-4d74-8da0-50bddfeaaf00 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0e30c4f4-8f4e-4d74-8da0-50bddfeaaf00 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0e30c4f4-8f4e-4d74-8da0-50bddfeaaf00 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:16 devstack sudo[87917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:40:16 devstack sudo[87917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-04fb98ea-42dc-470f-89a6-922cc4d82958 tempest-VolumesTestJSON-829222027 None] Acquiring lock "cinder-5a9eafd2-d37f-4a85-836e-753e080c7ec4-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-04fb98ea-42dc-470f-89a6-922cc4d82958 tempest-VolumesTestJSON-829222027 None] Lock "cinder-5a9eafd2-d37f-4a85-836e-753e080c7ec4-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-04fb98ea-42dc-470f-89a6-922cc4d82958 tempest-VolumesTestJSON-829222027 None] Acquiring lock "cinder-quobyte-5a9eafd2-d37f-4a85-836e-753e080c7ec4" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-04fb98ea-42dc-470f-89a6-922cc4d82958 tempest-VolumesTestJSON-829222027 None] Lock "cinder-quobyte-5a9eafd2-d37f-4a85-836e-753e080c7ec4" acquired by "delete_volume" :: waited 0.007s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:16 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebeb437-5de8-459b-b37f-c88f1ff99cfb]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-04fb98ea-42dc-470f-89a6-922cc4d82958 tempest-VolumesTestJSON-829222027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5a9eafd2-d37f-4a85-836e-753e080c7ec4 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:16 devstack sudo[87920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5a9eafd2-d37f-4a85-836e-753e080c7ec4 Apr 02 12:40:16 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:16 devstack sudo[87917]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0e30c4f4-8f4e-4d74-8da0-50bddfeaaf00 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.487s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:16 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-0e30c4f4-8f4e-4d74-8da0-50bddfeaaf00 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:40:16 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-0e30c4f4-8f4e-4d74-8da0-50bddfeaaf00 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Deleted volume successfully. Apr 02 12:40:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0e30c4f4-8f4e-4d74-8da0-50bddfeaaf00 tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "cinder-0a948b45-db25-4a71-b191-4b4238abcb0c-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:17 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-04fb98ea-42dc-470f-89a6-922cc4d82958 tempest-VolumesTestJSON-829222027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5a9eafd2-d37f-4a85-836e-753e080c7ec4" returned: 0 in 0.513s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-04fb98ea-42dc-470f-89a6-922cc4d82958 tempest-VolumesTestJSON-829222027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5a9eafd2-d37f-4a85-836e-753e080c7ec4 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:17 devstack sudo[87925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5a9eafd2-d37f-4a85-836e-753e080c7ec4 Apr 02 12:40:17 devstack sudo[87925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:17 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7a0fe2fd-0c61-483f-97a2-97c4e1326c5a tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "cinder-5ca2f83d-daa8-4ba1-b96e-1c2eef75379e-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:17 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7a0fe2fd-0c61-483f-97a2-97c4e1326c5a tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "cinder-5ca2f83d-daa8-4ba1-b96e-1c2eef75379e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:17 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7a0fe2fd-0c61-483f-97a2-97c4e1326c5a tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "cinder-quobyte-5ca2f83d-daa8-4ba1-b96e-1c2eef75379e" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:17 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7a0fe2fd-0c61-483f-97a2-97c4e1326c5a tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "cinder-quobyte-5ca2f83d-daa8-4ba1-b96e-1c2eef75379e" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:17 devstack sudo[87925]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-04fb98ea-42dc-470f-89a6-922cc4d82958 tempest-VolumesTestJSON-829222027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5a9eafd2-d37f-4a85-836e-753e080c7ec4" returned: 0 in 0.424s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:17 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[652f3c92-3f05-4068-bd36-a09dec3b6292]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7a0fe2fd-0c61-483f-97a2-97c4e1326c5a tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5ca2f83d-daa8-4ba1-b96e-1c2eef75379e {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:17 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-04fb98ea-42dc-470f-89a6-922cc4d82958 tempest-VolumesTestJSON-829222027 None] Lock "cinder-quobyte-5a9eafd2-d37f-4a85-836e-753e080c7ec4" released by "delete_volume" :: held 0.984s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:17 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-04fb98ea-42dc-470f-89a6-922cc4d82958 tempest-VolumesTestJSON-829222027 None] Created reservations ['a45efbc7-c149-4874-83c7-d02c7147d99d', 'd3765515-e214-47ac-b2ac-676f8a1c4c23', '8b8ccf87-a114-4d06-95db-e31f0a0903ae', 'f085a961-e922-4e3f-957f-0b3cf7fa0f9f'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:40:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-04fb98ea-42dc-470f-89a6-922cc4d82958 tempest-VolumesTestJSON-829222027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-04fb98ea-42dc-470f-89a6-922cc4d82958 tempest-VolumesTestJSON-829222027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:17 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-04fb98ea-42dc-470f-89a6-922cc4d82958 tempest-VolumesTestJSON-829222027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:17 devstack sudo[87930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5ca2f83d-daa8-4ba1-b96e-1c2eef75379e Apr 02 12:40:17 devstack sudo[87930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:17 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-04fb98ea-42dc-470f-89a6-922cc4d82958 tempest-VolumesTestJSON-829222027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-04fb98ea-42dc-470f-89a6-922cc4d82958 tempest-VolumesTestJSON-829222027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-04fb98ea-42dc-470f-89a6-922cc4d82958 tempest-VolumesTestJSON-829222027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:17 devstack sudo[87932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:40:17 devstack sudo[87932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:17 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f0038e5d-ee87-489c-be17-6b56f1c6985d tempest-VolumesTestJSON-829222027 None] Acquiring lock "cinder-a4a7a753-22a9-43f4-93f1-e0635c2c57a5-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:17 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f0038e5d-ee87-489c-be17-6b56f1c6985d tempest-VolumesTestJSON-829222027 None] Lock "cinder-a4a7a753-22a9-43f4-93f1-e0635c2c57a5-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:17 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f0038e5d-ee87-489c-be17-6b56f1c6985d tempest-VolumesTestJSON-829222027 None] Acquiring lock "cinder-quobyte-a4a7a753-22a9-43f4-93f1-e0635c2c57a5" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:17 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f0038e5d-ee87-489c-be17-6b56f1c6985d tempest-VolumesTestJSON-829222027 None] Lock "cinder-quobyte-a4a7a753-22a9-43f4-93f1-e0635c2c57a5" acquired by "delete_volume" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:17 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9b0149-ea7a-41f7-a220-adfeee1cb4df]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f0038e5d-ee87-489c-be17-6b56f1c6985d tempest-VolumesTestJSON-829222027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a4a7a753-22a9-43f4-93f1-e0635c2c57a5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:17 devstack sudo[87934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a4a7a753-22a9-43f4-93f1-e0635c2c57a5 Apr 02 12:40:17 devstack sudo[87934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:18 devstack sudo[87932]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-04fb98ea-42dc-470f-89a6-922cc4d82958 tempest-VolumesTestJSON-829222027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.447s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:18 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-04fb98ea-42dc-470f-89a6-922cc4d82958 tempest-VolumesTestJSON-829222027 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:40:18 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-04fb98ea-42dc-470f-89a6-922cc4d82958 tempest-VolumesTestJSON-829222027 None] Deleted volume successfully. Apr 02 12:40:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-04fb98ea-42dc-470f-89a6-922cc4d82958 tempest-VolumesTestJSON-829222027 None] Lock "cinder-5a9eafd2-d37f-4a85-836e-753e080c7ec4-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:18 devstack sudo[87930]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7a0fe2fd-0c61-483f-97a2-97c4e1326c5a tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5ca2f83d-daa8-4ba1-b96e-1c2eef75379e" returned: 0 in 0.658s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7a0fe2fd-0c61-483f-97a2-97c4e1326c5a tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5ca2f83d-daa8-4ba1-b96e-1c2eef75379e {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:18 devstack sudo[87942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5ca2f83d-daa8-4ba1-b96e-1c2eef75379e Apr 02 12:40:18 devstack sudo[87942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:18 devstack sudo[87934]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f0038e5d-ee87-489c-be17-6b56f1c6985d tempest-VolumesTestJSON-829222027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a4a7a753-22a9-43f4-93f1-e0635c2c57a5" returned: 0 in 0.538s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f0038e5d-ee87-489c-be17-6b56f1c6985d tempest-VolumesTestJSON-829222027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a4a7a753-22a9-43f4-93f1-e0635c2c57a5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:18 devstack sudo[87945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a4a7a753-22a9-43f4-93f1-e0635c2c57a5 Apr 02 12:40:18 devstack sudo[87945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:18 devstack sudo[87942]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7a0fe2fd-0c61-483f-97a2-97c4e1326c5a tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5ca2f83d-daa8-4ba1-b96e-1c2eef75379e" returned: 0 in 0.424s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7a0fe2fd-0c61-483f-97a2-97c4e1326c5a tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "cinder-quobyte-5ca2f83d-daa8-4ba1-b96e-1c2eef75379e" released by "delete_volume" :: held 1.110s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:18 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-7a0fe2fd-0c61-483f-97a2-97c4e1326c5a tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Created reservations ['91b21253-5a23-4e18-b841-102d691bd711', 'c4df8f61-7e5e-4c1a-a4c3-11638a8f8287', 'ea527b86-db07-4b0f-a002-115c69ee00ce', '260baa56-cc0d-4219-9ae7-bd577c713161'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:40:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7a0fe2fd-0c61-483f-97a2-97c4e1326c5a tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7a0fe2fd-0c61-483f-97a2-97c4e1326c5a tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:18 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7a0fe2fd-0c61-483f-97a2-97c4e1326c5a tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:18 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7a0fe2fd-0c61-483f-97a2-97c4e1326c5a tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7a0fe2fd-0c61-483f-97a2-97c4e1326c5a tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7a0fe2fd-0c61-483f-97a2-97c4e1326c5a tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:18 devstack sudo[87949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:40:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-5496f74e-720c-44a5-a0fb-4ebb9a4abe7c tempest-VolumesNegativeTest-1854614387 None] Acquiring lock "cinder-307922b1-3d89-4d18-93c8-50c8f9b90362-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:18 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-5496f74e-720c-44a5-a0fb-4ebb9a4abe7c tempest-VolumesNegativeTest-1854614387 None] Lock "cinder-307922b1-3d89-4d18-93c8-50c8f9b90362-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-5496f74e-720c-44a5-a0fb-4ebb9a4abe7c tempest-VolumesNegativeTest-1854614387 None] Acquiring lock "cinder-quobyte-307922b1-3d89-4d18-93c8-50c8f9b90362" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:18 devstack sudo[87945]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-5496f74e-720c-44a5-a0fb-4ebb9a4abe7c tempest-VolumesNegativeTest-1854614387 None] Lock "cinder-quobyte-307922b1-3d89-4d18-93c8-50c8f9b90362" acquired by "delete_volume" :: waited 0.020s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f0038e5d-ee87-489c-be17-6b56f1c6985d tempest-VolumesTestJSON-829222027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a4a7a753-22a9-43f4-93f1-e0635c2c57a5" returned: 0 in 0.511s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:18 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b8e64f-a923-431d-8b0e-be6781dc4cb0]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5496f74e-720c-44a5-a0fb-4ebb9a4abe7c tempest-VolumesNegativeTest-1854614387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-307922b1-3d89-4d18-93c8-50c8f9b90362 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f0038e5d-ee87-489c-be17-6b56f1c6985d tempest-VolumesTestJSON-829222027 None] Lock "cinder-quobyte-a4a7a753-22a9-43f4-93f1-e0635c2c57a5" released by "delete_volume" :: held 1.079s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:18 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-f0038e5d-ee87-489c-be17-6b56f1c6985d tempest-VolumesTestJSON-829222027 None] Created reservations ['6f67bcd0-cefb-4c60-8b63-a3fe41a9f59e', '3f8583f5-32db-4c82-b492-a2bdc0011b44', 'c2b4ebbf-1513-4a85-a443-45a9fa2d7323', 'e7793e90-63b4-4b1f-b116-9f3c83f9dc6c'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:40:18 devstack sudo[87951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-307922b1-3d89-4d18-93c8-50c8f9b90362 Apr 02 12:40:18 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-f0038e5d-ee87-489c-be17-6b56f1c6985d tempest-VolumesTestJSON-829222027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-f0038e5d-ee87-489c-be17-6b56f1c6985d tempest-VolumesTestJSON-829222027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:19 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-f0038e5d-ee87-489c-be17-6b56f1c6985d tempest-VolumesTestJSON-829222027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:19 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-f0038e5d-ee87-489c-be17-6b56f1c6985d tempest-VolumesTestJSON-829222027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-f0038e5d-ee87-489c-be17-6b56f1c6985d tempest-VolumesTestJSON-829222027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f0038e5d-ee87-489c-be17-6b56f1c6985d tempest-VolumesTestJSON-829222027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:19 devstack sudo[87953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:40:19 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:19 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7a0fe2fd-0c61-483f-97a2-97c4e1326c5a tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.421s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:19 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-7a0fe2fd-0c61-483f-97a2-97c4e1326c5a tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:40:19 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-7a0fe2fd-0c61-483f-97a2-97c4e1326c5a tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Deleted volume successfully. Apr 02 12:40:19 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7a0fe2fd-0c61-483f-97a2-97c4e1326c5a tempest-CreateVolumesFromSourceVolumeTest-1330264519 None] Lock "cinder-5ca2f83d-daa8-4ba1-b96e-1c2eef75379e-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:19 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5496f74e-720c-44a5-a0fb-4ebb9a4abe7c tempest-VolumesNegativeTest-1854614387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-307922b1-3d89-4d18-93c8-50c8f9b90362" returned: 0 in 0.451s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5496f74e-720c-44a5-a0fb-4ebb9a4abe7c tempest-VolumesNegativeTest-1854614387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-307922b1-3d89-4d18-93c8-50c8f9b90362 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:19 devstack sudo[87959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-307922b1-3d89-4d18-93c8-50c8f9b90362 Apr 02 12:40:19 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:19 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f0038e5d-ee87-489c-be17-6b56f1c6985d tempest-VolumesTestJSON-829222027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.398s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:19 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-f0038e5d-ee87-489c-be17-6b56f1c6985d tempest-VolumesTestJSON-829222027 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:40:19 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-f0038e5d-ee87-489c-be17-6b56f1c6985d tempest-VolumesTestJSON-829222027 None] Deleted volume successfully. Apr 02 12:40:19 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f0038e5d-ee87-489c-be17-6b56f1c6985d tempest-VolumesTestJSON-829222027 None] Lock "cinder-a4a7a753-22a9-43f4-93f1-e0635c2c57a5-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:19 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5496f74e-720c-44a5-a0fb-4ebb9a4abe7c tempest-VolumesNegativeTest-1854614387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-307922b1-3d89-4d18-93c8-50c8f9b90362" returned: 0 in 0.404s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:19 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-5496f74e-720c-44a5-a0fb-4ebb9a4abe7c tempest-VolumesNegativeTest-1854614387 None] Lock "cinder-quobyte-307922b1-3d89-4d18-93c8-50c8f9b90362" released by "delete_volume" :: held 0.877s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:19 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-5496f74e-720c-44a5-a0fb-4ebb9a4abe7c tempest-VolumesNegativeTest-1854614387 None] Created reservations ['4d94c044-2d72-491f-9b72-bab87f6d9356', 'a2a441d6-305c-4a49-997e-cc4c74cc42f8', 'd0cc2535-9d9f-4d71-aa17-97964bf7ac68', '14f45189-b606-4202-ba5d-4ce9a4ae9ea8'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:40:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-5496f74e-720c-44a5-a0fb-4ebb9a4abe7c tempest-VolumesNegativeTest-1854614387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-5496f74e-720c-44a5-a0fb-4ebb9a4abe7c tempest-VolumesNegativeTest-1854614387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:19 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-5496f74e-720c-44a5-a0fb-4ebb9a4abe7c tempest-VolumesNegativeTest-1854614387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:19 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-5496f74e-720c-44a5-a0fb-4ebb9a4abe7c tempest-VolumesNegativeTest-1854614387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-5496f74e-720c-44a5-a0fb-4ebb9a4abe7c tempest-VolumesNegativeTest-1854614387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5496f74e-720c-44a5-a0fb-4ebb9a4abe7c tempest-VolumesNegativeTest-1854614387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:19 devstack sudo[87963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:40:19 devstack sudo[87963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:20 devstack sudo[87963]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5496f74e-720c-44a5-a0fb-4ebb9a4abe7c tempest-VolumesNegativeTest-1854614387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.535s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:20 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-5496f74e-720c-44a5-a0fb-4ebb9a4abe7c tempest-VolumesNegativeTest-1854614387 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:40:20 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-5496f74e-720c-44a5-a0fb-4ebb9a4abe7c tempest-VolumesNegativeTest-1854614387 None] Deleted volume successfully. Apr 02 12:40:20 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-5496f74e-720c-44a5-a0fb-4ebb9a4abe7c tempest-VolumesNegativeTest-1854614387 None] Lock "cinder-307922b1-3d89-4d18-93c8-50c8f9b90362-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:21 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Flow 'volume_create_manager' (1a43d35e-00bb-4149-b896-30f4025530e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6278173-3eef-4c3b-8497-44bcd6dff42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6278173-3eef-4c3b-8497-44bcd6dff42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-178257043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d7e4bf-c234-45f6-a58d-716bbafdec1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37dfe47257774aa7a81be0c539ae37b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:22Z,use_quota=True,user_id='1743e62543c54761a12451329e969ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ab443cb-389e-4e18-ac39-0a2f6bdf1719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ab443cb-389e-4e18-ac39-0a2f6bdf1719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aecec1c5-546b-47e6-86fd-44cef9372198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aecec1c5-546b-47e6-86fd-44cef9372198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9d7e4bf-c234-45f6-a58d-716bbafdec1d', 'volume_name': 'volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d7420ab-00d0-4699-b25b-a521ddafa6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d7420ab-00d0-4699-b25b-a521ddafa6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d36267-f4e6-4ff3-9bb2-9f5260c5410d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:22 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Volume e9d7e4bf-c234-45f6-a58d-716bbafdec1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d', 'volume_size': 1} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-178257043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d7e4bf-c234-45f6-a58d-716bbafdec1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37dfe47257774aa7a81be0c539ae37b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:22Z,use_quota=True,user_id='1743e62543c54761a12451329e969ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Creating volume e9d7e4bf-c234-45f6-a58d-716bbafdec1d {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:40:22 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:22 devstack sudo[87966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d 1073741824 Apr 02 12:40:22 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Flow 'volume_create_manager' (e06fe49b-c6fe-4520-aa5b-8aafa902a9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c922f79-a17c-445e-b1f0-d3208bf97775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c922f79-a17c-445e-b1f0-d3208bf97775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7bf8210-3b13-44be-b4fe-a3dc2c490447,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0fcd799655d43af877906b68e3abfaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:22Z,use_quota=True,user_id='7060edc021934d04986b727de51c2f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (702f3748-c847-4681-ad01-9e4df7e6fc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (702f3748-c847-4681-ad01-9e4df7e6fc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f566fa3-f9c9-426d-8eb6-f9daeea59805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f566fa3-f9c9-426d-8eb6-f9daeea59805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7bf8210-3b13-44be-b4fe-a3dc2c490447', 'volume_name': 'volume-b7bf8210-3b13-44be-b4fe-a3dc2c490447', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e36dd7d-65f0-4dcd-a416-ac1e3772dd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e36dd7d-65f0-4dcd-a416-ac1e3772dd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9afe5de3-a3b5-484e-886f-560cd1a14fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:22 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Volume b7bf8210-3b13-44be-b4fe-a3dc2c490447: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7bf8210-3b13-44be-b4fe-a3dc2c490447', 'volume_size': 1} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:22 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d 1073741824" returned: 0 in 0.579s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:22 devstack sudo[87971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d Apr 02 12:40:22 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:23 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-76071433-0451-4cf5-8d92-28f1ca859184 tempest-GroupSnapshotsTest-865490240 None] Group tempest-GroupSnapshotsTest-Group-685410474: creating Apr 02 12:40:23 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-76071433-0451-4cf5-8d92-28f1ca859184 tempest-GroupSnapshotsTest-865490240 None] Group tempest-GroupSnapshotsTest-Group-685410474: created successfully Apr 02 12:40:23 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d" returned: 0 in 0.452s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:23 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-76071433-0451-4cf5-8d92-28f1ca859184 tempest-GroupSnapshotsTest-865490240 None] Create group completed successfully. Apr 02 12:40:23 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:40:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.818s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:23 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7bf8210-3b13-44be-b4fe-a3dc2c490447,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0fcd799655d43af877906b68e3abfaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:22Z,use_quota=True,user_id='7060edc021934d04986b727de51c2f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:40:23 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Creating volume b7bf8210-3b13-44be-b4fe-a3dc2c490447 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:40:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:23 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:23 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:23 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:40:23 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:40:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b7bf8210-3b13-44be-b4fe-a3dc2c490447 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:23 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d36267-f4e6-4ff3-9bb2-9f5260c5410d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:23 devstack sudo[87974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b7bf8210-3b13-44be-b4fe-a3dc2c490447 1073741824 Apr 02 12:40:23 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:23 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5cac9ba-329c-4bda-9084-be09ab835403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:23 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Volume volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d (e9d7e4bf-c234-45f6-a58d-716bbafdec1d): created successfully Apr 02 12:40:23 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5cac9ba-329c-4bda-9084-be09ab835403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:23 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Flow 'volume_create_manager' (1a43d35e-00bb-4149-b896-30f4025530e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:23 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-bd3ec151-f487-41fc-8142-7eb193321fd6 tempest-VolumeDependencyTests-81981976 None] Created volume successfully. Apr 02 12:40:23 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b7bf8210-3b13-44be-b4fe-a3dc2c490447 1073741824" returned: 0 in 0.501s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b7bf8210-3b13-44be-b4fe-a3dc2c490447 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:23 devstack sudo[87979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b7bf8210-3b13-44be-b4fe-a3dc2c490447 Apr 02 12:40:23 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:24 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b7bf8210-3b13-44be-b4fe-a3dc2c490447" returned: 0 in 0.404s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9afe5de3-a3b5-484e-886f-560cd1a14fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7bf8210-3b13-44be-b4fe-a3dc2c490447', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2298d9-1f5f-4384-8b60-197d3c8335e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:24 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Volume volume-b7bf8210-3b13-44be-b4fe-a3dc2c490447 (b7bf8210-3b13-44be-b4fe-a3dc2c490447): created successfully Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2298d9-1f5f-4384-8b60-197d3c8335e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Flow 'volume_create_manager' (e06fe49b-c6fe-4520-aa5b-8aafa902a9e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:24 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-c12ffca0-e6ed-4afd-9ad5-31b40a89b60b tempest-CinderUnicodeTest-1886101099 None] Created volume successfully. Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-57943a7d-e83d-498a-853d-72225a847d23 tempest-VolumeDependencyTests-81981976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-57943a7d-e83d-498a-853d-72225a847d23 tempest-VolumeDependencyTests-81981976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-57943a7d-e83d-498a-853d-72225a847d23 tempest-VolumeDependencyTests-81981976 None] Creating offline snapshot b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0 of volume e9d7e4bf-c234-45f6-a58d-716bbafdec1d {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e581a09b-83d9-4fc3-b287-9a2bad485170]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-57943a7d-e83d-498a-853d-72225a847d23 tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:24 devstack sudo[87982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d Apr 02 12:40:24 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Flow 'volume_create_manager' (52c6aa58-cebc-45ff-811b-b96e9d6b4dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (256563ab-529b-4a78-9e4b-616e36a24742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (256563ab-529b-4a78-9e4b-616e36a24742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1606093039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4ee7e567-04d8-4aa3-8514-9de4ec850e57,host='devstack@QuobyteHD#QuobyteHD',id=0170b5c9-efb3-4de2-803b-e1cacae8e6a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772395a8a9224449891dabcd8ec0d482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:24Z,use_quota=True,user_id='05d864696a7f4971812274cabd066631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969ac2f1-dbaf-4175-b1bd-0188f3c1ef29),volume_type_id=969ac2f1-dbaf-4175-b1bd-0188f3c1ef29)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75006a92-4bb5-4fe1-bf11-1b8f8c712751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75006a92-4bb5-4fe1-bf11-1b8f8c712751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be791cc0-9060-4678-be07-697aed7489a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be791cc0-9060-4678-be07-697aed7489a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0170b5c9-efb3-4de2-803b-e1cacae8e6a6', 'volume_name': 'volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6c4cd0-a40f-47ff-a504-115a47dc82c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6c4cd0-a40f-47ff-a504-115a47dc82c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a88e711-bfd9-45df-a91b-962c7349bfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:24 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Volume 0170b5c9-efb3-4de2-803b-e1cacae8e6a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6', 'volume_size': 1} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Flow 'volume_create_manager' (1c8e900d-3b25-4b8c-8b6d-d4b8bb30e538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9db9322-c22f-4d96-87c0-5ae23bfe7b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9db9322-c22f-4d96-87c0-5ae23bfe7b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1435716196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5376ce53-38fb-4213-98b2-d5d86a5e3d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0fcd799655d43af877906b68e3abfaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:25Z,use_quota=True,user_id='7060edc021934d04986b727de51c2f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85644d48-bdbe-49a7-829c-8fc8e088d964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85644d48-bdbe-49a7-829c-8fc8e088d964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (691f1914-1368-45e4-b762-05f9f9bb07f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (691f1914-1368-45e4-b762-05f9f9bb07f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5376ce53-38fb-4213-98b2-d5d86a5e3d21', 'volume_name': 'volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3f96c3-a4a7-4529-b853-bf4d47e268c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3f96c3-a4a7-4529-b853-bf4d47e268c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a5a63c-2187-4c76-96ca-471249ef4952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:24 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Volume 5376ce53-38fb-4213-98b2-d5d86a5e3d21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21', 'volume_size': 1} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:24 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-57943a7d-e83d-498a-853d-72225a847d23 tempest-VolumeDependencyTests-81981976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d" returned: 0 in 0.547s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-57943a7d-e83d-498a-853d-72225a847d23 tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:24 devstack sudo[87987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0 1G Apr 02 12:40:24 devstack sudo[87987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:25 devstack sudo[87987]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-57943a7d-e83d-498a-853d-72225a847d23 tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0 1G" returned: 0 in 0.491s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-57943a7d-e83d-498a-853d-72225a847d23 tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:25 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0 Apr 02 12:40:25 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:25 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-57943a7d-e83d-498a-853d-72225a847d23 tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0" returned: 0 in 0.453s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:25 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-57943a7d-e83d-498a-853d-72225a847d23 tempest-VolumeDependencyTests-81981976 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0 is being set with open permissions: ugo+rw Apr 02 12:40:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-57943a7d-e83d-498a-853d-72225a847d23 tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:25 devstack sudo[87997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0 Apr 02 12:40:25 devstack sudo[87997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:26 devstack sudo[87997]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-57943a7d-e83d-498a-853d-72225a847d23 tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0" returned: 0 in 0.382s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-57943a7d-e83d-498a-853d-72225a847d23 tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:26 devstack sudo[88000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.info Apr 02 12:40:26 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:26 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-57943a7d-e83d-498a-853d-72225a847d23 tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.info" returned: 0 in 0.421s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:26 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-57943a7d-e83d-498a-853d-72225a847d23 tempest-VolumeDependencyTests-81981976 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.info is being set with open permissions: ugo+rw Apr 02 12:40:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-57943a7d-e83d-498a-853d-72225a847d23 tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:26 devstack sudo[88003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.info Apr 02 12:40:26 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:27 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-57943a7d-e83d-498a-853d-72225a847d23 tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.info" returned: 0 in 0.434s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-57943a7d-e83d-498a-853d-72225a847d23 tempest-VolumeDependencyTests-81981976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.787s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.411s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:27 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4ee7e567-04d8-4aa3-8514-9de4ec850e57,created_at=2026-04-02T10:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1606093039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4ee7e567-04d8-4aa3-8514-9de4ec850e57,host='devstack@QuobyteHD#QuobyteHD',id=0170b5c9-efb3-4de2-803b-e1cacae8e6a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772395a8a9224449891dabcd8ec0d482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:24Z,use_quota=True,user_id='05d864696a7f4971812274cabd066631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969ac2f1-dbaf-4175-b1bd-0188f3c1ef29),volume_type_id=969ac2f1-dbaf-4175-b1bd-0188f3c1ef29)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:40:27 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Creating volume 0170b5c9-efb3-4de2-803b-e1cacae8e6a6 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:40:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:27 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:27 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:27 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:40:27 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:40:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:27 devstack sudo[88006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6 1073741824 Apr 02 12:40:27 devstack sudo[88006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:27 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-57943a7d-e83d-498a-853d-72225a847d23 tempest-VolumeDependencyTests-81981976 None] Create snapshot completed successfully Apr 02 12:40:27 devstack sudo[88006]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6 1073741824" returned: 0 in 0.506s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:27 devstack sudo[88012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6 Apr 02 12:40:27 devstack sudo[88012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:27 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:40:27 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Flow 'volume_create_manager' (5c1376b2-2f79-4ef2-845f-04dbe610e2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:27 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d52f4a32-0cb0-4606-a78d-68eebd361b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:27 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d52f4a32-0cb0-4606-a78d-68eebd361b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1040041270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d416111f-698e-45e1-82af-db2cf5d26fcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37dfe47257774aa7a81be0c539ae37b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:28Z,use_quota=True,user_id='1743e62543c54761a12451329e969ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:27 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a04364-e96a-4a75-91b0-0cd9ab9bfb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:27 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a04364-e96a-4a75-91b0-0cd9ab9bfb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:27 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e61f04-5bce-48e5-9412-fe066fd76d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:27 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e61f04-5bce-48e5-9412-fe066fd76d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd416111f-698e-45e1-82af-db2cf5d26fcd', 'volume_name': 'volume-d416111f-698e-45e1-82af-db2cf5d26fcd', 'volume_size': 1, 'snapshot_id': 'b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0'}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:27 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbb5bdc3-e8f0-44ef-88da-6feba3470a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:27 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbb5bdc3-e8f0-44ef-88da-6feba3470a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:27 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af4921d-d2ab-4b90-afd2-4e306260db9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:27 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Volume d416111f-698e-45e1-82af-db2cf5d26fcd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d416111f-698e-45e1-82af-db2cf5d26fcd', 'volume_size': 1, 'snapshot_id': 'b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0'} Apr 02 12:40:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:28 devstack sudo[88012]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6" returned: 0 in 0.423s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.251s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1435716196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5376ce53-38fb-4213-98b2-d5d86a5e3d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0fcd799655d43af877906b68e3abfaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:25Z,use_quota=True,user_id='7060edc021934d04986b727de51c2f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Creating volume 5376ce53-38fb-4213-98b2-d5d86a5e3d21 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:40:28 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a88e711-bfd9-45df-a91b-962c7349bfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11efba03-bbdd-4d04-aea1-3a079b0c1857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:28 devstack sudo[88015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21 1073741824 Apr 02 12:40:28 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:28 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Volume volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6 (0170b5c9-efb3-4de2-803b-e1cacae8e6a6): created successfully Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11efba03-bbdd-4d04-aea1-3a079b0c1857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Flow 'volume_create_manager' (52c6aa58-cebc-45ff-811b-b96e9d6b4dd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:28 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-b3bc7998-f924-4b7b-959b-5efcb7f2c2cb tempest-GroupSnapshotsTest-865490240 None] Created volume successfully. Apr 02 12:40:28 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21 1073741824" returned: 0 in 0.476s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:28 devstack sudo[88020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21 Apr 02 12:40:28 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:28 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21" returned: 0 in 0.432s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.186s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Acquiring lock "cinder-quobyte-b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0-d416111f-698e-45e1-82af-db2cf5d26fcd" by "_create_volume_from_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a5a63c-2187-4c76-96ca-471249ef4952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (938873b4-c848-4079-bce0-3b93405a6a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:28 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Volume volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21 (5376ce53-38fb-4213-98b2-d5d86a5e3d21): created successfully Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (938873b4-c848-4079-bce0-3b93405a6a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Flow 'volume_create_manager' (1c8e900d-3b25-4b8c-8b6d-d4b8bb30e538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Lock "cinder-quobyte-b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0-d416111f-698e-45e1-82af-db2cf5d26fcd" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Creating volume d416111f-698e-45e1-82af-db2cf5d26fcd from snapshot b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0 {{(pid=82819) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:28 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:29 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:29 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:40:29 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Acquiring lock "cinder-quobyte-d416111f-698e-45e1-82af-db2cf5d26fcd" by "_copy_volume_from_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:29 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-dae77d78-6359-4a18-b0e3-8f418914ebc9 tempest-GroupSnapshotsTest-865490240 None] GroupSnapshot 0c6b2785-04cd-4809-8939-bd5289b2cb27: creating. Apr 02 12:40:29 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-80f04c85-53b7-492d-b564-b746c37857bd tempest-CinderUnicodeTest-1886101099 None] Created volume successfully. Apr 02 12:40:29 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Lock "cinder-quobyte-d416111f-698e-45e1-82af-db2cf5d26fcd" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:29 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] snapshot: b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0, volume: d416111f-698e-45e1-82af-db2cf5d26fcd, {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 12:40:29 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-dae77d78-6359-4a18-b0e3-8f418914ebc9 tempest-GroupSnapshotsTest-865490240 None] Group snapshot 0c6b2785-04cd-4809-8939-bd5289b2cb27: creating. {{(pid=82819) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 02 12:40:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:29 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:29 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-dae77d78-6359-4a18-b0e3-8f418914ebc9 tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:29 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[33151a0f-5003-4d13-9f9d-29230933ba96]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:29 devstack sudo[88023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0 Apr 02 12:40:29 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:29 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0" returned: 0 in 0.518s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:29 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:40:29 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 12:40:29 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Creating direct copy from snapshot {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 12:40:29 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48b1fe0-ead2-4edb-a01c-d69dfc6ba862]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:29 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d Apr 02 12:40:29 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:30 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d" returned: 0 in 0.518s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:30 devstack cinder-volume[82819]: DEBUG cinder.utils [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Path /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d416111f-698e-45e1-82af-db2cf5d26fcd not found in is_blk_device check {{(pid=82819) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 12:40:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d416111f-698e-45e1-82af-db2cf5d26fcd {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:30 devstack sudo[88033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d416111f-698e-45e1-82af-db2cf5d26fcd Apr 02 12:40:30 devstack sudo[88033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e6b0f694-dd08-4020-aeff-9d1d9d0f7b48 tempest-CinderUnicodeTest-1886101099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:32 devstack sudo[88033]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d416111f-698e-45e1-82af-db2cf5d26fcd" returned: 0 in 1.929s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:32 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e239df96-7f15-4533-870e-59dcf05058ea]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:32 devstack sudo[88045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d Apr 02 12:40:32 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:32 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d" returned: 0 in 0.572s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:32 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d, size 1024.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d416111f-698e-45e1-82af-db2cf5d26fcd {{(pid=82819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 12:40:32 devstack cinder-volume[82819]: INFO cinder.image.image_utils [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Converted 1024.00 MB image at 530.67 MB/s Apr 02 12:40:32 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d416111f-698e-45e1-82af-db2cf5d26fcd is being set with open permissions: ugo+rw Apr 02 12:40:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d416111f-698e-45e1-82af-db2cf5d26fcd {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:32 devstack sudo[88050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d416111f-698e-45e1-82af-db2cf5d26fcd Apr 02 12:40:32 devstack sudo[88050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:33 devstack sudo[88050]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d416111f-698e-45e1-82af-db2cf5d26fcd" returned: 0 in 0.402s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:33 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Lock "cinder-quobyte-d416111f-698e-45e1-82af-db2cf5d26fcd" released by "_copy_volume_from_snapshot" :: held 4.002s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:33 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Lock "cinder-quobyte-b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0-d416111f-698e-45e1-82af-db2cf5d26fcd" released by "_create_volume_from_snapshot" :: held 4.042s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.084s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-dae77d78-6359-4a18-b0e3-8f418914ebc9 tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.981s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:33 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-dae77d78-6359-4a18-b0e3-8f418914ebc9 tempest-GroupSnapshotsTest-865490240 None] Creating offline snapshot c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba of volume 0170b5c9-efb3-4de2-803b-e1cacae8e6a6 {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:40:33 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[5596db93-5045-4617-951d-d8ea895f2dbe]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-dae77d78-6359-4a18-b0e3-8f418914ebc9 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af4921d-d2ab-4b90-afd2-4e306260db9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d416111f-698e-45e1-82af-db2cf5d26fcd', 'volume_size': 1, 'snapshot_id': 'b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0'}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e82ed0-fd61-4187-a9bf-026615fb1e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:33 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Volume volume-d416111f-698e-45e1-82af-db2cf5d26fcd (d416111f-698e-45e1-82af-db2cf5d26fcd): created successfully Apr 02 12:40:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e82ed0-fd61-4187-a9bf-026615fb1e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Flow 'volume_create_manager' (5c1376b2-2f79-4ef2-845f-04dbe610e2f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:33 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-55b5f4d1-9bb5-463c-bea9-47ca781c59bf tempest-VolumeDependencyTests-81981976 None] Created volume successfully. Apr 02 12:40:33 devstack sudo[88053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6 Apr 02 12:40:33 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:33 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-dae77d78-6359-4a18-b0e3-8f418914ebc9 tempest-GroupSnapshotsTest-865490240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6" returned: 0 in 0.491s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-dae77d78-6359-4a18-b0e3-8f418914ebc9 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:33 devstack sudo[88058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba 1G Apr 02 12:40:33 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:34 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-dae77d78-6359-4a18-b0e3-8f418914ebc9 tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba 1G" returned: 0 in 0.499s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-dae77d78-6359-4a18-b0e3-8f418914ebc9 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:34 devstack sudo[88063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba Apr 02 12:40:34 devstack sudo[88063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a49c3ede-5a0b-40bf-9ca3-903f03efa87c tempest-VolumeDependencyTests-81981976 None] Acquiring lock "cinder-b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0-delete_snapshot" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a49c3ede-5a0b-40bf-9ca3-903f03efa87c tempest-VolumeDependencyTests-81981976 None] Lock "cinder-b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a49c3ede-5a0b-40bf-9ca3-903f03efa87c tempest-VolumeDependencyTests-81981976 None] Acquiring lock "cinder-quobyte-e9d7e4bf-c234-45f6-a58d-716bbafdec1d" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a49c3ede-5a0b-40bf-9ca3-903f03efa87c tempest-VolumeDependencyTests-81981976 None] Lock "cinder-quobyte-e9d7e4bf-c234-45f6-a58d-716bbafdec1d" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a49c3ede-5a0b-40bf-9ca3-903f03efa87c tempest-VolumeDependencyTests-81981976 None] Acquiring lock "cinder-quobyte-b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a49c3ede-5a0b-40bf-9ca3-903f03efa87c tempest-VolumeDependencyTests-81981976 None] Lock "cinder-quobyte-b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-a49c3ede-5a0b-40bf-9ca3-903f03efa87c tempest-VolumeDependencyTests-81981976 None] Deleting offline snapshot b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0 of volume e9d7e4bf-c234-45f6-a58d-716bbafdec1d {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:40:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-a49c3ede-5a0b-40bf-9ca3-903f03efa87c tempest-VolumeDependencyTests-81981976 None] snapshot_file for this snap is: volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:40:34 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b03f1c-f29c-4210-941f-ff582e132d32]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a49c3ede-5a0b-40bf-9ca3-903f03efa87c tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:34 devstack sudo[88065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0 Apr 02 12:40:34 devstack sudo[88065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:34 devstack sudo[88063]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-dae77d78-6359-4a18-b0e3-8f418914ebc9 tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba" returned: 0 in 0.494s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:34 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-dae77d78-6359-4a18-b0e3-8f418914ebc9 tempest-GroupSnapshotsTest-865490240 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba is being set with open permissions: ugo+rw: NotImplementedError Apr 02 12:40:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-dae77d78-6359-4a18-b0e3-8f418914ebc9 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:34 devstack sudo[88071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba Apr 02 12:40:34 devstack sudo[88071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:34 devstack sudo[88065]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a49c3ede-5a0b-40bf-9ca3-903f03efa87c tempest-VolumeDependencyTests-81981976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0" returned: 0 in 0.491s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-a49c3ede-5a0b-40bf-9ca3-903f03efa87c tempest-VolumeDependencyTests-81981976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:40:34 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6d20e8-eec9-489d-afce-be087343d567]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a49c3ede-5a0b-40bf-9ca3-903f03efa87c tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:34 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d Apr 02 12:40:34 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:34 devstack sudo[88071]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-dae77d78-6359-4a18-b0e3-8f418914ebc9 tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba" returned: 0 in 0.406s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-dae77d78-6359-4a18-b0e3-8f418914ebc9 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:34 devstack sudo[88078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.info Apr 02 12:40:34 devstack sudo[88078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:35 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a49c3ede-5a0b-40bf-9ca3-903f03efa87c tempest-VolumeDependencyTests-81981976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d" returned: 0 in 0.458s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a49c3ede-5a0b-40bf-9ca3-903f03efa87c tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:35 devstack sudo[88083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0 Apr 02 12:40:35 devstack sudo[88083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:35 devstack sudo[88078]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-dae77d78-6359-4a18-b0e3-8f418914ebc9 tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.info" returned: 0 in 0.443s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:35 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-dae77d78-6359-4a18-b0e3-8f418914ebc9 tempest-GroupSnapshotsTest-865490240 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.info is being set with open permissions: ugo+rw: NotImplementedError Apr 02 12:40:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-dae77d78-6359-4a18-b0e3-8f418914ebc9 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:35 devstack sudo[88086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.info Apr 02 12:40:35 devstack sudo[88086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:35 devstack sudo[88083]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a49c3ede-5a0b-40bf-9ca3-903f03efa87c tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0" returned: 0 in 0.477s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a49c3ede-5a0b-40bf-9ca3-903f03efa87c tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:35 devstack sudo[88091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0 Apr 02 12:40:35 devstack sudo[88091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:35 devstack sudo[88086]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-dae77d78-6359-4a18-b0e3-8f418914ebc9 tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.info" returned: 0 in 0.437s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-dae77d78-6359-4a18-b0e3-8f418914ebc9 tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.823s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e6b0f694-dd08-4020-aeff-9d1d9d0f7b48 tempest-CinderUnicodeTest-1886101099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.652s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:35 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-e6b0f694-dd08-4020-aeff-9d1d9d0f7b48 tempest-CinderUnicodeTest-1886101099 None] Creating offline snapshot 2e1cc321-7c74-4e9d-b070-655ca3079771 of volume 5376ce53-38fb-4213-98b2-d5d86a5e3d21 {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:40:35 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[426e28ae-7288-4e32-96e7-d1c7f03292eb]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e6b0f694-dd08-4020-aeff-9d1d9d0f7b48 tempest-CinderUnicodeTest-1886101099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:35 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-dae77d78-6359-4a18-b0e3-8f418914ebc9 tempest-GroupSnapshotsTest-865490240 None] group_snapshot 0c6b2785-04cd-4809-8939-bd5289b2cb27: created successfully Apr 02 12:40:35 devstack sudo[88094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21 Apr 02 12:40:35 devstack sudo[88094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:36 devstack sudo[88091]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a49c3ede-5a0b-40bf-9ca3-903f03efa87c tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d.b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0" returned: 0 in 0.427s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:36 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a49c3ede-5a0b-40bf-9ca3-903f03efa87c tempest-VolumeDependencyTests-81981976 None] Lock "cinder-quobyte-b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0" released by "_delete_snapshot" :: held 1.917s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:36 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a49c3ede-5a0b-40bf-9ca3-903f03efa87c tempest-VolumeDependencyTests-81981976 None] Lock "cinder-quobyte-e9d7e4bf-c234-45f6-a58d-716bbafdec1d" released by "delete_snapshot" :: held 1.929s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:36 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-a49c3ede-5a0b-40bf-9ca3-903f03efa87c tempest-VolumeDependencyTests-81981976 None] Created reservations ['d176b835-cc5b-4c93-a004-3a7a066d382f', 'dbb83e04-e094-428f-8667-ddf4dc02e798', '010b2027-c22d-4310-985b-e11bbb9656f7', 'f460ee3f-63e6-4d2d-a9ff-ed83d3623186'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:40:36 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-a49c3ede-5a0b-40bf-9ca3-903f03efa87c tempest-VolumeDependencyTests-81981976 None] Delete snapshot completed successfully. Apr 02 12:40:36 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a49c3ede-5a0b-40bf-9ca3-903f03efa87c tempest-VolumeDependencyTests-81981976 None] Lock "cinder-b3db3bd4-bd01-45d7-8ce5-f3502bf5d3d0-delete_snapshot" released by "delete_snapshot" :: held 2.019s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:36 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-387604b6-bb6d-446d-aa7d-57023ef39f15 tempest-VolumeDependencyTests-81981976 None] Acquiring lock "cinder-e9d7e4bf-c234-45f6-a58d-716bbafdec1d-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:36 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-387604b6-bb6d-446d-aa7d-57023ef39f15 tempest-VolumeDependencyTests-81981976 None] Lock "cinder-e9d7e4bf-c234-45f6-a58d-716bbafdec1d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:36 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-387604b6-bb6d-446d-aa7d-57023ef39f15 tempest-VolumeDependencyTests-81981976 None] Acquiring lock "cinder-quobyte-e9d7e4bf-c234-45f6-a58d-716bbafdec1d" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:36 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-387604b6-bb6d-446d-aa7d-57023ef39f15 tempest-VolumeDependencyTests-81981976 None] Lock "cinder-quobyte-e9d7e4bf-c234-45f6-a58d-716bbafdec1d" acquired by "delete_volume" :: waited 0.024s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:36 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c214f9-47f0-415b-8506-bc4e2d709c39]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-387604b6-bb6d-446d-aa7d-57023ef39f15 tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:36 devstack sudo[88097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d Apr 02 12:40:36 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:36 devstack sudo[88094]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e6b0f694-dd08-4020-aeff-9d1d9d0f7b48 tempest-CinderUnicodeTest-1886101099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21" returned: 0 in 0.562s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e6b0f694-dd08-4020-aeff-9d1d9d0f7b48 tempest-CinderUnicodeTest-1886101099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21.2e1cc321-7c74-4e9d-b070-655ca3079771 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:36 devstack sudo[88102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21.2e1cc321-7c74-4e9d-b070-655ca3079771 1G Apr 02 12:40:36 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:36 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-387604b6-bb6d-446d-aa7d-57023ef39f15 tempest-VolumeDependencyTests-81981976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d" returned: 0 in 0.475s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-387604b6-bb6d-446d-aa7d-57023ef39f15 tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:36 devstack sudo[88109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d Apr 02 12:40:36 devstack sudo[88109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:36 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e6b0f694-dd08-4020-aeff-9d1d9d0f7b48 tempest-CinderUnicodeTest-1886101099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21.2e1cc321-7c74-4e9d-b070-655ca3079771 1G" returned: 0 in 0.470s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e6b0f694-dd08-4020-aeff-9d1d9d0f7b48 tempest-CinderUnicodeTest-1886101099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21.2e1cc321-7c74-4e9d-b070-655ca3079771 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:36 devstack sudo[88112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21.2e1cc321-7c74-4e9d-b070-655ca3079771 Apr 02 12:40:36 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:37 devstack sudo[88109]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-387604b6-bb6d-446d-aa7d-57023ef39f15 tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e9d7e4bf-c234-45f6-a58d-716bbafdec1d" returned: 0 in 0.464s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-387604b6-bb6d-446d-aa7d-57023ef39f15 tempest-VolumeDependencyTests-81981976 None] Lock "cinder-quobyte-e9d7e4bf-c234-45f6-a58d-716bbafdec1d" released by "delete_volume" :: held 0.968s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-387604b6-bb6d-446d-aa7d-57023ef39f15 tempest-VolumeDependencyTests-81981976 None] Created reservations ['5e18ae0a-bbc1-478b-9e71-1a94702004b7', '0a78e14c-3bcf-4497-bc78-f34a8d47c275', 'dee3b515-7c60-437f-a4f3-d78fc4c48cba', '9407870e-197a-4610-9701-be8de49131f6'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-387604b6-bb6d-446d-aa7d-57023ef39f15 tempest-VolumeDependencyTests-81981976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-387604b6-bb6d-446d-aa7d-57023ef39f15 tempest-VolumeDependencyTests-81981976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-387604b6-bb6d-446d-aa7d-57023ef39f15 tempest-VolumeDependencyTests-81981976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-387604b6-bb6d-446d-aa7d-57023ef39f15 tempest-VolumeDependencyTests-81981976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-387604b6-bb6d-446d-aa7d-57023ef39f15 tempest-VolumeDependencyTests-81981976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-387604b6-bb6d-446d-aa7d-57023ef39f15 tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:37 devstack sudo[88118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:40:37 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:37 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e6b0f694-dd08-4020-aeff-9d1d9d0f7b48 tempest-CinderUnicodeTest-1886101099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21.2e1cc321-7c74-4e9d-b070-655ca3079771" returned: 0 in 0.542s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:37 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-e6b0f694-dd08-4020-aeff-9d1d9d0f7b48 tempest-CinderUnicodeTest-1886101099 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21.2e1cc321-7c74-4e9d-b070-655ca3079771 is being set with open permissions: ugo+rw Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e6b0f694-dd08-4020-aeff-9d1d9d0f7b48 tempest-CinderUnicodeTest-1886101099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21.2e1cc321-7c74-4e9d-b070-655ca3079771 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:37 devstack sudo[88120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21.2e1cc321-7c74-4e9d-b070-655ca3079771 Apr 02 12:40:37 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Flow 'volume_create_manager' (33628b26-01f5-40b8-aea6-b23d1f7fde9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25defdcb-67e1-4bcc-a314-fcd617635f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25defdcb-67e1-4bcc-a314-fcd617635f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1085965643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86bd787-38fd-4ae4-8ac4-e28262c57159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37dfe47257774aa7a81be0c539ae37b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:38Z,use_quota=True,user_id='1743e62543c54761a12451329e969ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0def21e-1a8a-477c-b1e6-0ad77d0bfbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0def21e-1a8a-477c-b1e6-0ad77d0bfbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec22df9-d13e-4e3e-a367-779e21068bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec22df9-d13e-4e3e-a367-779e21068bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b86bd787-38fd-4ae4-8ac4-e28262c57159', 'volume_name': 'volume-b86bd787-38fd-4ae4-8ac4-e28262c57159', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5829b5f-85f9-4f69-92ac-af66f139edf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5829b5f-85f9-4f69-92ac-af66f139edf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6c56a9-ab40-4557-be6c-4440c6913cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:37 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Volume b86bd787-38fd-4ae4-8ac4-e28262c57159: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b86bd787-38fd-4ae4-8ac4-e28262c57159', 'volume_size': 1} Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:37 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-387604b6-bb6d-446d-aa7d-57023ef39f15 tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.460s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-387604b6-bb6d-446d-aa7d-57023ef39f15 tempest-VolumeDependencyTests-81981976 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:40:37 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-387604b6-bb6d-446d-aa7d-57023ef39f15 tempest-VolumeDependencyTests-81981976 None] Deleted volume successfully. Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-387604b6-bb6d-446d-aa7d-57023ef39f15 tempest-VolumeDependencyTests-81981976 None] Lock "cinder-e9d7e4bf-c234-45f6-a58d-716bbafdec1d-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:37 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e6b0f694-dd08-4020-aeff-9d1d9d0f7b48 tempest-CinderUnicodeTest-1886101099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21.2e1cc321-7c74-4e9d-b070-655ca3079771" returned: 0 in 0.449s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e6b0f694-dd08-4020-aeff-9d1d9d0f7b48 tempest-CinderUnicodeTest-1886101099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:37 devstack sudo[88125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21.info Apr 02 12:40:37 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:38 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e6b0f694-dd08-4020-aeff-9d1d9d0f7b48 tempest-CinderUnicodeTest-1886101099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21.info" returned: 0 in 0.394s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:38 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-e6b0f694-dd08-4020-aeff-9d1d9d0f7b48 tempest-CinderUnicodeTest-1886101099 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21.info is being set with open permissions: ugo+rw Apr 02 12:40:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e6b0f694-dd08-4020-aeff-9d1d9d0f7b48 tempest-CinderUnicodeTest-1886101099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:38 devstack sudo[88128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21.info Apr 02 12:40:38 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:38 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e6b0f694-dd08-4020-aeff-9d1d9d0f7b48 tempest-CinderUnicodeTest-1886101099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21.info" returned: 0 in 0.411s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e6b0f694-dd08-4020-aeff-9d1d9d0f7b48 tempest-CinderUnicodeTest-1886101099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.901s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.556s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:38 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "cinder-quobyte-c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba-bec650d3-1c80-485b-9802-ef290d69ebe8" by "_create_volume_from_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:38 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba-bec650d3-1c80-485b-9802-ef290d69ebe8" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Creating volume bec650d3-1c80-485b-9802-ef290d69ebe8 from snapshot c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba {{(pid=82819) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 02 12:40:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:40:38 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "cinder-quobyte-bec650d3-1c80-485b-9802-ef290d69ebe8" by "_copy_volume_from_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:38 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-e6b0f694-dd08-4020-aeff-9d1d9d0f7b48 tempest-CinderUnicodeTest-1886101099 None] Create snapshot completed successfully Apr 02 12:40:38 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-bec650d3-1c80-485b-9802-ef290d69ebe8" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] snapshot: c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba, volume: bec650d3-1c80-485b-9802-ef290d69ebe8, {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 12:40:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:38 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f257db05-10b3-4c22-8782-6b638c0bd0e4]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:38 devstack sudo[88131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba Apr 02 12:40:38 devstack sudo[88131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:39 devstack sudo[88131]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba" returned: 0 in 0.475s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:39 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:40:39 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6 {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 12:40:39 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Creating direct copy from snapshot {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 12:40:39 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1b3329-a8af-4df4-b2f5-3baa11059644]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:39 devstack sudo[88136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6 Apr 02 12:40:39 devstack sudo[88136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:39 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0c9f6d1d-c964-4e70-8250-9863d2f9f66d tempest-CinderUnicodeTest-1886101099 None] Acquiring lock "cinder-2e1cc321-7c74-4e9d-b070-655ca3079771-delete_snapshot" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:39 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0c9f6d1d-c964-4e70-8250-9863d2f9f66d tempest-CinderUnicodeTest-1886101099 None] Lock "cinder-2e1cc321-7c74-4e9d-b070-655ca3079771-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:39 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0c9f6d1d-c964-4e70-8250-9863d2f9f66d tempest-CinderUnicodeTest-1886101099 None] Acquiring lock "cinder-quobyte-5376ce53-38fb-4213-98b2-d5d86a5e3d21" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:39 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0c9f6d1d-c964-4e70-8250-9863d2f9f66d tempest-CinderUnicodeTest-1886101099 None] Lock "cinder-quobyte-5376ce53-38fb-4213-98b2-d5d86a5e3d21" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:39 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0c9f6d1d-c964-4e70-8250-9863d2f9f66d tempest-CinderUnicodeTest-1886101099 None] Acquiring lock "cinder-quobyte-2e1cc321-7c74-4e9d-b070-655ca3079771" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:39 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0c9f6d1d-c964-4e70-8250-9863d2f9f66d tempest-CinderUnicodeTest-1886101099 None] Lock "cinder-quobyte-2e1cc321-7c74-4e9d-b070-655ca3079771" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:39 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-0c9f6d1d-c964-4e70-8250-9863d2f9f66d tempest-CinderUnicodeTest-1886101099 None] Deleting offline snapshot 2e1cc321-7c74-4e9d-b070-655ca3079771 of volume 5376ce53-38fb-4213-98b2-d5d86a5e3d21 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:40:39 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-0c9f6d1d-c964-4e70-8250-9863d2f9f66d tempest-CinderUnicodeTest-1886101099 None] snapshot_file for this snap is: volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21.2e1cc321-7c74-4e9d-b070-655ca3079771 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:40:39 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1f1035-935d-460e-b5f6-eeb6b8fbc7ee]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0c9f6d1d-c964-4e70-8250-9863d2f9f66d tempest-CinderUnicodeTest-1886101099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21.2e1cc321-7c74-4e9d-b070-655ca3079771 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:39 devstack sudo[88138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21.2e1cc321-7c74-4e9d-b070-655ca3079771 Apr 02 12:40:39 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:39 devstack sudo[88136]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6" returned: 0 in 0.511s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:39 devstack cinder-volume[82819]: DEBUG cinder.utils [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Path /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-bec650d3-1c80-485b-9802-ef290d69ebe8 not found in is_blk_device check {{(pid=82819) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 12:40:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-bec650d3-1c80-485b-9802-ef290d69ebe8 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:39 devstack sudo[88143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-bec650d3-1c80-485b-9802-ef290d69ebe8 Apr 02 12:40:39 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:40 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0c9f6d1d-c964-4e70-8250-9863d2f9f66d tempest-CinderUnicodeTest-1886101099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21.2e1cc321-7c74-4e9d-b070-655ca3079771" returned: 0 in 0.470s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:40 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-0c9f6d1d-c964-4e70-8250-9863d2f9f66d tempest-CinderUnicodeTest-1886101099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:40:40 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[c560c377-82d8-40fb-bf0e-12edab54dc6b]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0c9f6d1d-c964-4e70-8250-9863d2f9f66d tempest-CinderUnicodeTest-1886101099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:40 devstack sudo[88150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21 Apr 02 12:40:40 devstack sudo[88150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:41 devstack sudo[88150]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0c9f6d1d-c964-4e70-8250-9863d2f9f66d tempest-CinderUnicodeTest-1886101099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21" returned: 0 in 1.724s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0c9f6d1d-c964-4e70-8250-9863d2f9f66d tempest-CinderUnicodeTest-1886101099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21.2e1cc321-7c74-4e9d-b070-655ca3079771 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:41 devstack sudo[88169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21.2e1cc321-7c74-4e9d-b070-655ca3079771 Apr 02 12:40:41 devstack sudo[88169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:41 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-bec650d3-1c80-485b-9802-ef290d69ebe8" returned: 0 in 2.148s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:41 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4c4a98-0a6c-4fa0-b3fa-e27c549fd9d7]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:42 devstack sudo[88171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6 Apr 02 12:40:42 devstack sudo[88171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:42 devstack sudo[88169]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0c9f6d1d-c964-4e70-8250-9863d2f9f66d tempest-CinderUnicodeTest-1886101099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21.2e1cc321-7c74-4e9d-b070-655ca3079771" returned: 0 in 0.465s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0c9f6d1d-c964-4e70-8250-9863d2f9f66d tempest-CinderUnicodeTest-1886101099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21.2e1cc321-7c74-4e9d-b070-655ca3079771 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:42 devstack sudo[88176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21.2e1cc321-7c74-4e9d-b070-655ca3079771 Apr 02 12:40:42 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:42 devstack sudo[88171]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6" returned: 0 in 0.603s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:42 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6, size 1024.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-bec650d3-1c80-485b-9802-ef290d69ebe8 {{(pid=82819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 12:40:42 devstack cinder-volume[82819]: INFO cinder.image.image_utils [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Converted 1024.00 MB image at 476.20 MB/s Apr 02 12:40:42 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-bec650d3-1c80-485b-9802-ef290d69ebe8 is being set with open permissions: ugo+rw: NotImplementedError Apr 02 12:40:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-bec650d3-1c80-485b-9802-ef290d69ebe8 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:42 devstack sudo[88181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-bec650d3-1c80-485b-9802-ef290d69ebe8 Apr 02 12:40:42 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:42 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0c9f6d1d-c964-4e70-8250-9863d2f9f66d tempest-CinderUnicodeTest-1886101099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21.2e1cc321-7c74-4e9d-b070-655ca3079771" returned: 0 in 0.429s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:42 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0c9f6d1d-c964-4e70-8250-9863d2f9f66d tempest-CinderUnicodeTest-1886101099 None] Lock "cinder-quobyte-2e1cc321-7c74-4e9d-b070-655ca3079771" released by "_delete_snapshot" :: held 3.144s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:42 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0c9f6d1d-c964-4e70-8250-9863d2f9f66d tempest-CinderUnicodeTest-1886101099 None] Lock "cinder-quobyte-5376ce53-38fb-4213-98b2-d5d86a5e3d21" released by "delete_snapshot" :: held 3.169s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:42 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-0c9f6d1d-c964-4e70-8250-9863d2f9f66d tempest-CinderUnicodeTest-1886101099 None] Created reservations ['57b47639-c21c-4aab-9473-1ad69afa89b1', '97333f87-3df1-46d7-aa66-462bde4eeb18', '6f1d82fd-1fb2-49e8-a4f2-08984eb22900', '19ed8547-439f-4377-9ac5-d8b2e612334f'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:40:42 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-0c9f6d1d-c964-4e70-8250-9863d2f9f66d tempest-CinderUnicodeTest-1886101099 None] Delete snapshot completed successfully. Apr 02 12:40:42 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0c9f6d1d-c964-4e70-8250-9863d2f9f66d tempest-CinderUnicodeTest-1886101099 None] Lock "cinder-2e1cc321-7c74-4e9d-b070-655ca3079771-delete_snapshot" released by "delete_snapshot" :: held 3.280s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:43 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-8164518a-cf99-43ac-b499-43534d2c0cd7 tempest-CinderUnicodeTest-1886101099 None] Acquiring lock "cinder-5376ce53-38fb-4213-98b2-d5d86a5e3d21-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:43 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-8164518a-cf99-43ac-b499-43534d2c0cd7 tempest-CinderUnicodeTest-1886101099 None] Lock "cinder-5376ce53-38fb-4213-98b2-d5d86a5e3d21-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:43 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-8164518a-cf99-43ac-b499-43534d2c0cd7 tempest-CinderUnicodeTest-1886101099 None] Acquiring lock "cinder-quobyte-5376ce53-38fb-4213-98b2-d5d86a5e3d21" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:43 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-8164518a-cf99-43ac-b499-43534d2c0cd7 tempest-CinderUnicodeTest-1886101099 None] Lock "cinder-quobyte-5376ce53-38fb-4213-98b2-d5d86a5e3d21" acquired by "delete_volume" :: waited 0.007s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:43 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe8ea90-4979-4982-8b7e-e6467223e139]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8164518a-cf99-43ac-b499-43534d2c0cd7 tempest-CinderUnicodeTest-1886101099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:43 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-bec650d3-1c80-485b-9802-ef290d69ebe8" returned: 0 in 0.474s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:43 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-bec650d3-1c80-485b-9802-ef290d69ebe8" released by "_copy_volume_from_snapshot" :: held 4.272s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:43 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba-bec650d3-1c80-485b-9802-ef290d69ebe8" released by "_create_volume_from_snapshot" :: held 4.294s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.309s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.360s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:43 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1085965643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86bd787-38fd-4ae4-8ac4-e28262c57159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37dfe47257774aa7a81be0c539ae37b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:38Z,use_quota=True,user_id='1743e62543c54761a12451329e969ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:40:43 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Creating volume b86bd787-38fd-4ae4-8ac4-e28262c57159 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:40:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:43 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:43 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:43 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:40:43 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:40:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:43 devstack sudo[88186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159 1073741824 Apr 02 12:40:43 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:43 devstack sudo[88185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21 Apr 02 12:40:43 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:43 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-4d548e94-492c-4986-92b7-50c80ecc3e6f tempest-GroupSnapshotsTest-865490240 None] Create group from source-snapshot-0c6b2785-04cd-4809-8939-bd5289b2cb27 completed successfully. Apr 02 12:40:43 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8164518a-cf99-43ac-b499-43534d2c0cd7 tempest-CinderUnicodeTest-1886101099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21" returned: 0 in 0.519s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8164518a-cf99-43ac-b499-43534d2c0cd7 tempest-CinderUnicodeTest-1886101099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:43 devstack sudo[88195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21 Apr 02 12:40:43 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:43 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159 1073741824" returned: 0 in 0.517s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:43 devstack sudo[88197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159 Apr 02 12:40:43 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:44 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159" returned: 0 in 0.386s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:44 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8164518a-cf99-43ac-b499-43534d2c0cd7 tempest-CinderUnicodeTest-1886101099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-5376ce53-38fb-4213-98b2-d5d86a5e3d21" returned: 0 in 0.437s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6c56a9-ab40-4557-be6c-4440c6913cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b86bd787-38fd-4ae4-8ac4-e28262c57159', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e269614-1598-452a-9ba7-48f009098300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-8164518a-cf99-43ac-b499-43534d2c0cd7 tempest-CinderUnicodeTest-1886101099 None] Lock "cinder-quobyte-5376ce53-38fb-4213-98b2-d5d86a5e3d21" released by "delete_volume" :: held 1.009s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:44 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Volume volume-b86bd787-38fd-4ae4-8ac4-e28262c57159 (b86bd787-38fd-4ae4-8ac4-e28262c57159): created successfully Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e269614-1598-452a-9ba7-48f009098300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Flow 'volume_create_manager' (33628b26-01f5-40b8-aea6-b23d1f7fde9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:44 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-1e832af2-1e9d-4b53-b391-8252af06c9a7 tempest-VolumeDependencyTests-81981976 None] Created volume successfully. Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-8164518a-cf99-43ac-b499-43534d2c0cd7 tempest-CinderUnicodeTest-1886101099 None] Created reservations ['7a96552f-2c86-4dc7-967a-e40060fb5fb4', '97bd1b6f-2859-4ef2-88e4-c6edcefc9942', '8edb7c52-e67d-4815-b514-5260958b17aa', 'ada93a3c-d992-4164-aed7-a2a7a139f1bc'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-8164518a-cf99-43ac-b499-43534d2c0cd7 tempest-CinderUnicodeTest-1886101099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-8164518a-cf99-43ac-b499-43534d2c0cd7 tempest-CinderUnicodeTest-1886101099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-8164518a-cf99-43ac-b499-43534d2c0cd7 tempest-CinderUnicodeTest-1886101099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-8164518a-cf99-43ac-b499-43534d2c0cd7 tempest-CinderUnicodeTest-1886101099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-8164518a-cf99-43ac-b499-43534d2c0cd7 tempest-CinderUnicodeTest-1886101099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8164518a-cf99-43ac-b499-43534d2c0cd7 tempest-CinderUnicodeTest-1886101099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:44 devstack sudo[88201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:40:44 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-df381f62-affc-46e9-8f0d-959310cf2370 tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "cinder-quobyte-bec650d3-1c80-485b-9802-ef290d69ebe8" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-df381f62-affc-46e9-8f0d-959310cf2370 tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-bec650d3-1c80-485b-9802-ef290d69ebe8" acquired by "delete_volume" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b73ed32-1c51-41e9-a6f4-fda5f07b514c]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df381f62-affc-46e9-8f0d-959310cf2370 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-bec650d3-1c80-485b-9802-ef290d69ebe8 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:44 devstack sudo[88203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-bec650d3-1c80-485b-9802-ef290d69ebe8 Apr 02 12:40:44 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Flow 'volume_create_manager' (58ddd90f-dabb-4394-8d2a-5c2562a55b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f11d8cf-e4fd-4be6-9abd-540c4855d14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f11d8cf-e4fd-4be6-9abd-540c4855d14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-81362479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec990be1-9031-4e38-a116-1dad21ab251c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37dfe47257774aa7a81be0c539ae37b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b86bd787-38fd-4ae4-8ac4-e28262c57159,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:45Z,use_quota=True,user_id='1743e62543c54761a12451329e969ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757a0a14-cf07-4e94-9e89-99f189ecd764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757a0a14-cf07-4e94-9e89-99f189ecd764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc78411a-3c7d-48a7-b6d4-89798b9cecb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc78411a-3c7d-48a7-b6d4-89798b9cecb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ec990be1-9031-4e38-a116-1dad21ab251c', 'volume_name': 'volume-ec990be1-9031-4e38-a116-1dad21ab251c', 'volume_size': 1, 'source_volid': 'b86bd787-38fd-4ae4-8ac4-e28262c57159', 'source_volstatus': 'available'}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ff3c9f-8a68-4295-8c8a-55e554cb2325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ff3c9f-8a68-4295-8c8a-55e554cb2325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0045792b-67c4-4e70-ad35-d6fc7a4a9ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:44 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Volume ec990be1-9031-4e38-a116-1dad21ab251c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ec990be1-9031-4e38-a116-1dad21ab251c', 'volume_size': 1, 'source_volid': 'b86bd787-38fd-4ae4-8ac4-e28262c57159', 'source_volstatus': 'available'} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:44 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Cloning volume b86bd787-38fd-4ae4-8ac4-e28262c57159 to volume ec990be1-9031-4e38-a116-1dad21ab251c Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Creating offline snapshot bcd79b25-43dd-4b13-b073-caccda089e32 of volume b86bd787-38fd-4ae4-8ac4-e28262c57159 {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[008a9dec-363b-4e47-8dbf-40c4b97d52dd]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:44 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8164518a-cf99-43ac-b499-43534d2c0cd7 tempest-CinderUnicodeTest-1886101099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.554s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-8164518a-cf99-43ac-b499-43534d2c0cd7 tempest-CinderUnicodeTest-1886101099 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:40:44 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-8164518a-cf99-43ac-b499-43534d2c0cd7 tempest-CinderUnicodeTest-1886101099 None] Deleted volume successfully. Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-8164518a-cf99-43ac-b499-43534d2c0cd7 tempest-CinderUnicodeTest-1886101099 None] Lock "cinder-5376ce53-38fb-4213-98b2-d5d86a5e3d21-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:44 devstack sudo[88206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159 Apr 02 12:40:44 devstack sudo[88206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:44 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df381f62-affc-46e9-8f0d-959310cf2370 tempest-GroupSnapshotsTest-865490240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-bec650d3-1c80-485b-9802-ef290d69ebe8" returned: 0 in 0.520s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df381f62-affc-46e9-8f0d-959310cf2370 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-bec650d3-1c80-485b-9802-ef290d69ebe8 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:44 devstack sudo[88211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-bec650d3-1c80-485b-9802-ef290d69ebe8 Apr 02 12:40:44 devstack sudo[88211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:45 devstack sudo[88206]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159" returned: 0 in 0.452s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.bcd79b25-43dd-4b13-b073-caccda089e32 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:45 devstack sudo[88216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.bcd79b25-43dd-4b13-b073-caccda089e32 1G Apr 02 12:40:45 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:45 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1b27cae7-d8da-451c-a675-266f3250e824 tempest-CinderUnicodeTest-1886101099 None] Acquiring lock "cinder-b7bf8210-3b13-44be-b4fe-a3dc2c490447-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:45 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1b27cae7-d8da-451c-a675-266f3250e824 tempest-CinderUnicodeTest-1886101099 None] Lock "cinder-b7bf8210-3b13-44be-b4fe-a3dc2c490447-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:45 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1b27cae7-d8da-451c-a675-266f3250e824 tempest-CinderUnicodeTest-1886101099 None] Acquiring lock "cinder-quobyte-b7bf8210-3b13-44be-b4fe-a3dc2c490447" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:45 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1b27cae7-d8da-451c-a675-266f3250e824 tempest-CinderUnicodeTest-1886101099 None] Lock "cinder-quobyte-b7bf8210-3b13-44be-b4fe-a3dc2c490447" acquired by "delete_volume" :: waited 0.007s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:45 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f42a19a-ef35-4a20-af1c-de90a8fcf9b6]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1b27cae7-d8da-451c-a675-266f3250e824 tempest-CinderUnicodeTest-1886101099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b7bf8210-3b13-44be-b4fe-a3dc2c490447 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:45 devstack sudo[88218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b7bf8210-3b13-44be-b4fe-a3dc2c490447 Apr 02 12:40:45 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:45 devstack sudo[88211]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df381f62-affc-46e9-8f0d-959310cf2370 tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-bec650d3-1c80-485b-9802-ef290d69ebe8" returned: 0 in 0.491s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:45 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-df381f62-affc-46e9-8f0d-959310cf2370 tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-bec650d3-1c80-485b-9802-ef290d69ebe8" released by "delete_volume" :: held 1.047s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:45 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-df381f62-affc-46e9-8f0d-959310cf2370 tempest-GroupSnapshotsTest-865490240 None] Created reservations ['0bb679d9-b677-47c4-8ae8-607c571de48b'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:40:45 devstack cinder-volume[82819]: WARNING cinder.quota [None req-df381f62-affc-46e9-8f0d-959310cf2370 tempest-GroupSnapshotsTest-865490240 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1348199526 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1348199526, it is now deprecated. Please use the default quota class for default quota. Apr 02 12:40:45 devstack cinder-volume[82819]: WARNING cinder.quota [None req-df381f62-affc-46e9-8f0d-959310cf2370 tempest-GroupSnapshotsTest-865490240 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1348199526 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1348199526, it is now deprecated. Please use the default quota class for default quota. Apr 02 12:40:45 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-df381f62-affc-46e9-8f0d-959310cf2370 tempest-GroupSnapshotsTest-865490240 None] Created reservations ['053973f9-a6ef-4f51-bb73-8bab2a4a0c90', 'ed04a8c8-80a0-4d60-a7d8-502675dc0f0d', 'cfeadb81-779e-4c13-8511-7a4851b7d68c', '32a114ea-0ce9-42d9-b2ee-cc010ecbd11c'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:40:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-df381f62-affc-46e9-8f0d-959310cf2370 tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-df381f62-affc-46e9-8f0d-959310cf2370 tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:45 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-df381f62-affc-46e9-8f0d-959310cf2370 tempest-GroupSnapshotsTest-865490240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:45 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-df381f62-affc-46e9-8f0d-959310cf2370 tempest-GroupSnapshotsTest-865490240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-df381f62-affc-46e9-8f0d-959310cf2370 tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df381f62-affc-46e9-8f0d-959310cf2370 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:45 devstack sudo[88224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:40:45 devstack sudo[88224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:45 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.bcd79b25-43dd-4b13-b073-caccda089e32 1G" returned: 0 in 0.582s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b86bd787-38fd-4ae4-8ac4-e28262c57159 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.bcd79b25-43dd-4b13-b073-caccda089e32 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:45 devstack sudo[88226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b86bd787-38fd-4ae4-8ac4-e28262c57159 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.bcd79b25-43dd-4b13-b073-caccda089e32 Apr 02 12:40:45 devstack sudo[88226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:45 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1b27cae7-d8da-451c-a675-266f3250e824 tempest-CinderUnicodeTest-1886101099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b7bf8210-3b13-44be-b4fe-a3dc2c490447" returned: 0 in 0.547s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1b27cae7-d8da-451c-a675-266f3250e824 tempest-CinderUnicodeTest-1886101099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b7bf8210-3b13-44be-b4fe-a3dc2c490447 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:45 devstack sudo[88231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b7bf8210-3b13-44be-b4fe-a3dc2c490447 Apr 02 12:40:45 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:45 devstack sudo[88224]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df381f62-affc-46e9-8f0d-959310cf2370 tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.426s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:45 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-df381f62-affc-46e9-8f0d-959310cf2370 tempest-GroupSnapshotsTest-865490240 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:40:45 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-df381f62-affc-46e9-8f0d-959310cf2370 tempest-GroupSnapshotsTest-865490240 None] Delete group completed successfully. Apr 02 12:40:46 devstack sudo[88226]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b86bd787-38fd-4ae4-8ac4-e28262c57159 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.bcd79b25-43dd-4b13-b073-caccda089e32" returned: 0 in 0.420s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:46 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.bcd79b25-43dd-4b13-b073-caccda089e32 is being set with open permissions: ugo+rw Apr 02 12:40:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.bcd79b25-43dd-4b13-b073-caccda089e32 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:46 devstack sudo[88237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.bcd79b25-43dd-4b13-b073-caccda089e32 Apr 02 12:40:46 devstack sudo[88237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:46 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1b27cae7-d8da-451c-a675-266f3250e824 tempest-CinderUnicodeTest-1886101099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b7bf8210-3b13-44be-b4fe-a3dc2c490447" returned: 0 in 0.410s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:46 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1b27cae7-d8da-451c-a675-266f3250e824 tempest-CinderUnicodeTest-1886101099 None] Lock "cinder-quobyte-b7bf8210-3b13-44be-b4fe-a3dc2c490447" released by "delete_volume" :: held 0.978s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:46 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-1b27cae7-d8da-451c-a675-266f3250e824 tempest-CinderUnicodeTest-1886101099 None] Created reservations ['3ae12bbf-3a8c-464f-8130-17638983ad1a', 'b852ffa3-5892-47af-bc7b-d92866b54d5d', '6178cb73-fa63-4bd9-a66c-04c93abf2c4d', '458638d3-845e-45de-a43f-bd1e84d8805b'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:40:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-1b27cae7-d8da-451c-a675-266f3250e824 tempest-CinderUnicodeTest-1886101099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-1b27cae7-d8da-451c-a675-266f3250e824 tempest-CinderUnicodeTest-1886101099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:46 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-1b27cae7-d8da-451c-a675-266f3250e824 tempest-CinderUnicodeTest-1886101099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:46 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-1b27cae7-d8da-451c-a675-266f3250e824 tempest-CinderUnicodeTest-1886101099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-1b27cae7-d8da-451c-a675-266f3250e824 tempest-CinderUnicodeTest-1886101099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1b27cae7-d8da-451c-a675-266f3250e824 tempest-CinderUnicodeTest-1886101099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:46 devstack sudo[88240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:40:46 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:46 devstack sudo[88237]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.bcd79b25-43dd-4b13-b073-caccda089e32" returned: 0 in 0.430s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:46 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-f33c1ea9-ae3c-4544-ab39-ed9538a082b9 tempest-GroupSnapshotsTest-865490240 None] group_snapshot 0c6b2785-04cd-4809-8939-bd5289b2cb27: deleting Apr 02 12:40:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:46 devstack sudo[88243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.info Apr 02 12:40:46 devstack sudo[88243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:46 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-f33c1ea9-ae3c-4544-ab39-ed9538a082b9 tempest-GroupSnapshotsTest-865490240 None] group_snapshot 0c6b2785-04cd-4809-8939-bd5289b2cb27: deleting {{(pid=82819) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 02 12:40:46 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f33c1ea9-ae3c-4544-ab39-ed9538a082b9 tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "cinder-quobyte-0170b5c9-efb3-4de2-803b-e1cacae8e6a6" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:46 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f33c1ea9-ae3c-4544-ab39-ed9538a082b9 tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-0170b5c9-efb3-4de2-803b-e1cacae8e6a6" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:46 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f33c1ea9-ae3c-4544-ab39-ed9538a082b9 tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "cinder-quobyte-c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:46 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f33c1ea9-ae3c-4544-ab39-ed9538a082b9 tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:46 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-f33c1ea9-ae3c-4544-ab39-ed9538a082b9 tempest-GroupSnapshotsTest-865490240 None] Deleting offline snapshot c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba of volume 0170b5c9-efb3-4de2-803b-e1cacae8e6a6 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:40:46 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-f33c1ea9-ae3c-4544-ab39-ed9538a082b9 tempest-GroupSnapshotsTest-865490240 None] snapshot_file for this snap is: volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:40:46 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[437683ef-b16e-4033-a9f1-77996fcb68d6]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f33c1ea9-ae3c-4544-ab39-ed9538a082b9 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:46 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1b27cae7-d8da-451c-a675-266f3250e824 tempest-CinderUnicodeTest-1886101099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.481s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:46 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-1b27cae7-d8da-451c-a675-266f3250e824 tempest-CinderUnicodeTest-1886101099 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:40:46 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-1b27cae7-d8da-451c-a675-266f3250e824 tempest-CinderUnicodeTest-1886101099 None] Deleted volume successfully. Apr 02 12:40:46 devstack sudo[88246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba Apr 02 12:40:46 devstack sudo[88246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:46 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1b27cae7-d8da-451c-a675-266f3250e824 tempest-CinderUnicodeTest-1886101099 None] Lock "cinder-b7bf8210-3b13-44be-b4fe-a3dc2c490447-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:47 devstack sudo[88243]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.info" returned: 0 in 0.434s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:47 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.info is being set with open permissions: ugo+rw Apr 02 12:40:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:47 devstack sudo[88249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.info Apr 02 12:40:47 devstack sudo[88249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:47 devstack sudo[88246]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f33c1ea9-ae3c-4544-ab39-ed9538a082b9 tempest-GroupSnapshotsTest-865490240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba" returned: 0 in 0.482s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:47 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-f33c1ea9-ae3c-4544-ab39-ed9538a082b9 tempest-GroupSnapshotsTest-865490240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:40:47 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c0ccbe-60f7-4536-a138-712d0d8ae07e]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f33c1ea9-ae3c-4544-ab39-ed9538a082b9 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:47 devstack sudo[88254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6 Apr 02 12:40:47 devstack sudo[88254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:47 devstack sudo[88249]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.info" returned: 0 in 0.455s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:47 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Acquiring lock "cinder-quobyte-ec990be1-9031-4e38-a116-1dad21ab251c" by "_copy_volume_from_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:47 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Lock "cinder-quobyte-ec990be1-9031-4e38-a116-1dad21ab251c" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:47 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] snapshot: bcd79b25-43dd-4b13-b073-caccda089e32, volume: ec990be1-9031-4e38-a116-1dad21ab251c, {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 12:40:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:47 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:47 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:47 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[6558c8ba-77a1-4d7a-9806-26416e221d3e]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.bcd79b25-43dd-4b13-b073-caccda089e32 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:47 devstack sudo[88258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.bcd79b25-43dd-4b13-b073-caccda089e32 Apr 02 12:40:47 devstack sudo[88258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:47 devstack sudo[88254]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f33c1ea9-ae3c-4544-ab39-ed9538a082b9 tempest-GroupSnapshotsTest-865490240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6" returned: 0 in 0.589s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f33c1ea9-ae3c-4544-ab39-ed9538a082b9 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:47 devstack sudo[88263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba Apr 02 12:40:47 devstack sudo[88263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:48 devstack sudo[88258]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.bcd79b25-43dd-4b13-b073-caccda089e32" returned: 0 in 0.585s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:48 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b86bd787-38fd-4ae4-8ac4-e28262c57159(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:40:48 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159 {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 12:40:48 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Creating direct copy from snapshot {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 12:40:48 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ea64da-05cd-49de-8605-2fbab954735d]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:48 devstack sudo[88269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159 Apr 02 12:40:48 devstack sudo[88269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:48 devstack sudo[88263]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f33c1ea9-ae3c-4544-ab39-ed9538a082b9 tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba" returned: 0 in 0.596s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f33c1ea9-ae3c-4544-ab39-ed9538a082b9 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:48 devstack sudo[88274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba Apr 02 12:40:48 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:48 devstack sudo[88269]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159" returned: 0 in 0.602s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:48 devstack cinder-volume[82819]: DEBUG cinder.utils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Path /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ec990be1-9031-4e38-a116-1dad21ab251c not found in is_blk_device check {{(pid=82819) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 12:40:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ec990be1-9031-4e38-a116-1dad21ab251c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:48 devstack sudo[88279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ec990be1-9031-4e38-a116-1dad21ab251c Apr 02 12:40:48 devstack sudo[88279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:48 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f33c1ea9-ae3c-4544-ab39-ed9538a082b9 tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6.c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba" returned: 0 in 0.532s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:48 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f33c1ea9-ae3c-4544-ab39-ed9538a082b9 tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-c2c51096-5202-4c6e-b6b9-6d03b6c7a4ba" released by "_delete_snapshot" :: held 2.259s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:48 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f33c1ea9-ae3c-4544-ab39-ed9538a082b9 tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-0170b5c9-efb3-4de2-803b-e1cacae8e6a6" released by "delete_snapshot" :: held 2.276s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:49 devstack cinder-volume[82819]: WARNING cinder.quota [None req-f33c1ea9-ae3c-4544-ab39-ed9538a082b9 tempest-GroupSnapshotsTest-865490240 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1348199526 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1348199526, it is now deprecated. Please use the default quota class for default quota. Apr 02 12:40:49 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-f33c1ea9-ae3c-4544-ab39-ed9538a082b9 tempest-GroupSnapshotsTest-865490240 None] Created reservations ['fec430ed-cbb3-4fb1-968e-bed885eef3ff', '1dba9fa3-cc0a-4fd4-a7ed-d9586e23aa74', '4ead0aae-c57e-4738-bdde-388f991ef4e9', 'ecc12f5a-9ee8-4a07-a90c-220a7893b0a6'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:40:49 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-f33c1ea9-ae3c-4544-ab39-ed9538a082b9 tempest-GroupSnapshotsTest-865490240 None] group_snapshot 0c6b2785-04cd-4809-8939-bd5289b2cb27: deleted successfully Apr 02 12:40:50 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-98c31dca-693e-4f2f-ae62-cd723511d39c tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "cinder-quobyte-0170b5c9-efb3-4de2-803b-e1cacae8e6a6" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:50 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-98c31dca-693e-4f2f-ae62-cd723511d39c tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-0170b5c9-efb3-4de2-803b-e1cacae8e6a6" acquired by "delete_volume" :: waited 0.039s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:50 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[652ec20a-67c3-4f37-8339-55fa48699626]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-98c31dca-693e-4f2f-ae62-cd723511d39c tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:50 devstack sudo[88292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6 Apr 02 12:40:50 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:50 devstack sudo[88279]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ec990be1-9031-4e38-a116-1dad21ab251c" returned: 0 in 2.075s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:50 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a36d496-3ee4-4df5-b168-137ea9ff7a8c]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:50 devstack sudo[88294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159 Apr 02 12:40:50 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:51 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-98c31dca-693e-4f2f-ae62-cd723511d39c tempest-GroupSnapshotsTest-865490240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6" returned: 0 in 0.683s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-98c31dca-693e-4f2f-ae62-cd723511d39c tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:51 devstack sudo[88299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6 Apr 02 12:40:51 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:51 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159" returned: 0 in 0.628s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:51 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159, size 1024.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ec990be1-9031-4e38-a116-1dad21ab251c {{(pid=82819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 12:40:51 devstack cinder-volume[82819]: INFO cinder.image.image_utils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Converted 1024.00 MB image at 493.19 MB/s Apr 02 12:40:51 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ec990be1-9031-4e38-a116-1dad21ab251c is being set with open permissions: ugo+rw Apr 02 12:40:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ec990be1-9031-4e38-a116-1dad21ab251c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:51 devstack sudo[88305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ec990be1-9031-4e38-a116-1dad21ab251c Apr 02 12:40:51 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:51 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-98c31dca-693e-4f2f-ae62-cd723511d39c tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0170b5c9-efb3-4de2-803b-e1cacae8e6a6" returned: 0 in 0.418s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-98c31dca-693e-4f2f-ae62-cd723511d39c tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-0170b5c9-efb3-4de2-803b-e1cacae8e6a6" released by "delete_volume" :: held 1.182s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:51 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-98c31dca-693e-4f2f-ae62-cd723511d39c tempest-GroupSnapshotsTest-865490240 None] Created reservations ['47ed1871-b3bd-4db9-8010-f0b2254ac1a3'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:40:51 devstack cinder-volume[82819]: WARNING cinder.db.sqlalchemy.api [None req-98c31dca-693e-4f2f-ae62-cd723511d39c tempest-GroupSnapshotsTest-865490240 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1348199526'] Apr 02 12:40:51 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-98c31dca-693e-4f2f-ae62-cd723511d39c tempest-GroupSnapshotsTest-865490240 None] Created reservations ['8236d884-1c78-4a2a-a3bb-ec8ff41aaf56', '54632704-45d9-43fb-a75b-d69260e4f145', 'e864285d-3795-43b4-befa-3e5d47280cc8', '0a71b482-cd17-4f25-beb0-c076411d473e'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:40:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-98c31dca-693e-4f2f-ae62-cd723511d39c tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-98c31dca-693e-4f2f-ae62-cd723511d39c tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:51 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-98c31dca-693e-4f2f-ae62-cd723511d39c tempest-GroupSnapshotsTest-865490240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:51 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-98c31dca-693e-4f2f-ae62-cd723511d39c tempest-GroupSnapshotsTest-865490240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-98c31dca-693e-4f2f-ae62-cd723511d39c tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-98c31dca-693e-4f2f-ae62-cd723511d39c tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:51 devstack sudo[88307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:40:51 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:51 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ec990be1-9031-4e38-a116-1dad21ab251c" returned: 0 in 0.427s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Lock "cinder-quobyte-ec990be1-9031-4e38-a116-1dad21ab251c" released by "_copy_volume_from_snapshot" :: held 4.370s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Acquiring lock "cinder-quobyte-bcd79b25-43dd-4b13-b073-caccda089e32" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Lock "cinder-quobyte-bcd79b25-43dd-4b13-b073-caccda089e32" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:51 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Deleting offline snapshot bcd79b25-43dd-4b13-b073-caccda089e32 of volume b86bd787-38fd-4ae4-8ac4-e28262c57159 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:40:51 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] snapshot_file for this snap is: volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.bcd79b25-43dd-4b13-b073-caccda089e32 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:40:51 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[267074cf-e709-4f71-a918-4fbc36b0bcb9]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.bcd79b25-43dd-4b13-b073-caccda089e32 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:51 devstack sudo[88310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.bcd79b25-43dd-4b13-b073-caccda089e32 Apr 02 12:40:51 devstack sudo[88310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:52 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-98c31dca-693e-4f2f-ae62-cd723511d39c tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.427s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:52 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-98c31dca-693e-4f2f-ae62-cd723511d39c tempest-GroupSnapshotsTest-865490240 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:40:52 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-98c31dca-693e-4f2f-ae62-cd723511d39c tempest-GroupSnapshotsTest-865490240 None] Delete group completed successfully. Apr 02 12:40:52 devstack sudo[88310]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.bcd79b25-43dd-4b13-b073-caccda089e32" returned: 0 in 0.505s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:52 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b86bd787-38fd-4ae4-8ac4-e28262c57159(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:40:52 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd181bc-5ab3-4766-b805-6c71f402e665]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:52 devstack sudo[88316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159 Apr 02 12:40:52 devstack sudo[88316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:52 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-66fe2195-4d28-4d10-b1ed-3c6634727fae tempest-GroupSnapshotsTest-865490240 None] Group tempest-GroupSnapshotsTest-Group-814500111: creating Apr 02 12:40:52 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-66fe2195-4d28-4d10-b1ed-3c6634727fae tempest-GroupSnapshotsTest-865490240 None] Group tempest-GroupSnapshotsTest-Group-814500111: created successfully Apr 02 12:40:52 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-66fe2195-4d28-4d10-b1ed-3c6634727fae tempest-GroupSnapshotsTest-865490240 None] Create group completed successfully. Apr 02 12:40:52 devstack sudo[88316]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159" returned: 0 in 0.553s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.bcd79b25-43dd-4b13-b073-caccda089e32 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:53 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.bcd79b25-43dd-4b13-b073-caccda089e32 Apr 02 12:40:53 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:53 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.bcd79b25-43dd-4b13-b073-caccda089e32" returned: 0 in 0.439s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.bcd79b25-43dd-4b13-b073-caccda089e32 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:53 devstack sudo[88326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.bcd79b25-43dd-4b13-b073-caccda089e32 Apr 02 12:40:53 devstack sudo[88326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:53 devstack sudo[88326]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159.bcd79b25-43dd-4b13-b073-caccda089e32" returned: 0 in 0.377s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:53 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Lock "cinder-quobyte-bcd79b25-43dd-4b13-b073-caccda089e32" released by "_delete_snapshot" :: held 1.920s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.203s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:53 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0045792b-67c4-4e70-ad35-d6fc7a4a9ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec990be1-9031-4e38-a116-1dad21ab251c', 'volume_size': 1, 'source_volid': 'b86bd787-38fd-4ae4-8ac4-e28262c57159', 'source_volstatus': 'available'}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:53 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff033a7-39df-455d-9316-c6d489c77f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:53 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Volume volume-ec990be1-9031-4e38-a116-1dad21ab251c (ec990be1-9031-4e38-a116-1dad21ab251c): created successfully Apr 02 12:40:53 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff033a7-39df-455d-9316-c6d489c77f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:53 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Flow 'volume_create_manager' (58ddd90f-dabb-4394-8d2a-5c2562a55b7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:53 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-77379cfb-fd93-42dc-8032-5431d4571bfa tempest-VolumeDependencyTests-81981976 None] Created volume successfully. Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-dd308067-0488-450b-ac1e-cb4c00a49886 tempest-VolumeDependencyTests-81981976 None] Acquiring lock "cinder-b86bd787-38fd-4ae4-8ac4-e28262c57159-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-dd308067-0488-450b-ac1e-cb4c00a49886 tempest-VolumeDependencyTests-81981976 None] Lock "cinder-b86bd787-38fd-4ae4-8ac4-e28262c57159-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:INSERT=40,cinder:UPDATE=222,cinder:SELECT=166,cinder:DELETE=20 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-dd308067-0488-450b-ac1e-cb4c00a49886 tempest-VolumeDependencyTests-81981976 None] Acquiring lock "cinder-quobyte-b86bd787-38fd-4ae4-8ac4-e28262c57159" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-dd308067-0488-450b-ac1e-cb4c00a49886 tempest-VolumeDependencyTests-81981976 None] Lock "cinder-quobyte-b86bd787-38fd-4ae4-8ac4-e28262c57159" acquired by "delete_volume" :: waited 0.023s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44e25c1-d5c3-4107-ac1a-8918a3ac96f7]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-dd308067-0488-450b-ac1e-cb4c00a49886 tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Flow 'volume_create_manager' (1781e82b-946f-4be8-bb65-d5c3515980da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05840f56-e5cd-4e02-921a-d2928342bdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05840f56-e5cd-4e02-921a-d2928342bdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1214946114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bbf8a787-2474-4de3-b3e9-26059e794160,host='devstack@QuobyteHD#QuobyteHD',id=1ecc586f-24fb-4b1d-8813-9813927010fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772395a8a9224449891dabcd8ec0d482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:54Z,use_quota=True,user_id='05d864696a7f4971812274cabd066631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2cb9a3cd-efa8-4b5e-8c6d-0ba7da3de296),volume_type_id=2cb9a3cd-efa8-4b5e-8c6d-0ba7da3de296)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0d8bc3-87ad-4e55-820e-a70b4dcc8a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0d8bc3-87ad-4e55-820e-a70b4dcc8a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d711223-1dd9-473a-bc72-a3270928e8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d711223-1dd9-473a-bc72-a3270928e8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ecc586f-24fb-4b1d-8813-9813927010fe', 'volume_name': 'volume-1ecc586f-24fb-4b1d-8813-9813927010fe', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:54 devstack sudo[88329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159 Apr 02 12:40:54 devstack sudo[88329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e778826-0cf9-4221-9469-2dc586600a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e778826-0cf9-4221-9469-2dc586600a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40da92eb-fdeb-44b1-8881-4c604f95b3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:54 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Volume 1ecc586f-24fb-4b1d-8813-9813927010fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ecc586f-24fb-4b1d-8813-9813927010fe', 'volume_size': 1} Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bbf8a787-2474-4de3-b3e9-26059e794160,created_at=2026-04-02T10:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1214946114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bbf8a787-2474-4de3-b3e9-26059e794160,host='devstack@QuobyteHD#QuobyteHD',id=1ecc586f-24fb-4b1d-8813-9813927010fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772395a8a9224449891dabcd8ec0d482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:54Z,use_quota=True,user_id='05d864696a7f4971812274cabd066631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2cb9a3cd-efa8-4b5e-8c6d-0ba7da3de296),volume_type_id=2cb9a3cd-efa8-4b5e-8c6d-0ba7da3de296)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Creating volume 1ecc586f-24fb-4b1d-8813-9813927010fe {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:40:54 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:54 devstack sudo[88331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe 1073741824 Apr 02 12:40:54 devstack sudo[88331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:54 devstack sudo[88329]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-dd308067-0488-450b-ac1e-cb4c00a49886 tempest-VolumeDependencyTests-81981976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159" returned: 0 in 0.481s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-dd308067-0488-450b-ac1e-cb4c00a49886 tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:54 devstack sudo[88339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159 Apr 02 12:40:54 devstack sudo[88339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:54 devstack sudo[88331]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe 1073741824" returned: 0 in 0.449s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:54 devstack sudo[88341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe Apr 02 12:40:54 devstack sudo[88341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:55 devstack sudo[88339]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-dd308067-0488-450b-ac1e-cb4c00a49886 tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b86bd787-38fd-4ae4-8ac4-e28262c57159" returned: 0 in 0.404s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:55 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-dd308067-0488-450b-ac1e-cb4c00a49886 tempest-VolumeDependencyTests-81981976 None] Lock "cinder-quobyte-b86bd787-38fd-4ae4-8ac4-e28262c57159" released by "delete_volume" :: held 0.920s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:55 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:SELECT=167,cinder:INSERT=60,cinder:UPDATE=204,cinder:DELETE=12 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:40:55 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-dd308067-0488-450b-ac1e-cb4c00a49886 tempest-VolumeDependencyTests-81981976 None] Created reservations ['bd711813-c690-4bdd-966b-9c2d5c7884d0', '536b7c71-df54-47c5-9b6b-63b834df7a6d', '84a60da5-a8b8-4001-a6fe-6a00f22a356f', '831cf657-733c-4138-8276-d94b65d70985'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:40:55 devstack sudo[88341]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-dd308067-0488-450b-ac1e-cb4c00a49886 tempest-VolumeDependencyTests-81981976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-dd308067-0488-450b-ac1e-cb4c00a49886 tempest-VolumeDependencyTests-81981976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:55 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-dd308067-0488-450b-ac1e-cb4c00a49886 tempest-VolumeDependencyTests-81981976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:55 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-dd308067-0488-450b-ac1e-cb4c00a49886 tempest-VolumeDependencyTests-81981976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-dd308067-0488-450b-ac1e-cb4c00a49886 tempest-VolumeDependencyTests-81981976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-dd308067-0488-450b-ac1e-cb4c00a49886 tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe" returned: 0 in 0.438s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:55 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:40:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40da92eb-fdeb-44b1-8881-4c604f95b3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ecc586f-24fb-4b1d-8813-9813927010fe', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:55 devstack sudo[88345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:40:55 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9262339e-420c-47ee-9b6f-f8a89c9cce6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:55 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Volume volume-1ecc586f-24fb-4b1d-8813-9813927010fe (1ecc586f-24fb-4b1d-8813-9813927010fe): created successfully Apr 02 12:40:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9262339e-420c-47ee-9b6f-f8a89c9cce6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Flow 'volume_create_manager' (1781e82b-946f-4be8-bb65-d5c3515980da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:55 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-9b87e25e-652a-489c-ae26-0dff91ab392d tempest-GroupSnapshotsTest-865490240 None] Created volume successfully. Apr 02 12:40:55 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-aa105e38-6bf8-40d5-aecd-c5e061b50fba tempest-VolumeDependencyTests-81981976 None] Acquiring lock "cinder-ec990be1-9031-4e38-a116-1dad21ab251c-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:55 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-aa105e38-6bf8-40d5-aecd-c5e061b50fba tempest-VolumeDependencyTests-81981976 None] Lock "cinder-ec990be1-9031-4e38-a116-1dad21ab251c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:55 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-aa105e38-6bf8-40d5-aecd-c5e061b50fba tempest-VolumeDependencyTests-81981976 None] Acquiring lock "cinder-quobyte-ec990be1-9031-4e38-a116-1dad21ab251c" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:55 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-aa105e38-6bf8-40d5-aecd-c5e061b50fba tempest-VolumeDependencyTests-81981976 None] Lock "cinder-quobyte-ec990be1-9031-4e38-a116-1dad21ab251c" acquired by "delete_volume" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:55 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[482e213f-9748-42fc-8ef4-ad1afdf38e22]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-aa105e38-6bf8-40d5-aecd-c5e061b50fba tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ec990be1-9031-4e38-a116-1dad21ab251c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:55 devstack sudo[88347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ec990be1-9031-4e38-a116-1dad21ab251c Apr 02 12:40:55 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:55 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-dd308067-0488-450b-ac1e-cb4c00a49886 tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.426s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:55 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-dd308067-0488-450b-ac1e-cb4c00a49886 tempest-VolumeDependencyTests-81981976 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:40:55 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-dd308067-0488-450b-ac1e-cb4c00a49886 tempest-VolumeDependencyTests-81981976 None] Deleted volume successfully. Apr 02 12:40:55 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-dd308067-0488-450b-ac1e-cb4c00a49886 tempest-VolumeDependencyTests-81981976 None] Lock "cinder-b86bd787-38fd-4ae4-8ac4-e28262c57159-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:55 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-aa105e38-6bf8-40d5-aecd-c5e061b50fba tempest-VolumeDependencyTests-81981976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ec990be1-9031-4e38-a116-1dad21ab251c" returned: 0 in 0.449s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-aa105e38-6bf8-40d5-aecd-c5e061b50fba tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ec990be1-9031-4e38-a116-1dad21ab251c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:55 devstack sudo[88387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ec990be1-9031-4e38-a116-1dad21ab251c Apr 02 12:40:55 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:56 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-aa105e38-6bf8-40d5-aecd-c5e061b50fba tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ec990be1-9031-4e38-a116-1dad21ab251c" returned: 0 in 0.396s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-aa105e38-6bf8-40d5-aecd-c5e061b50fba tempest-VolumeDependencyTests-81981976 None] Lock "cinder-quobyte-ec990be1-9031-4e38-a116-1dad21ab251c" released by "delete_volume" :: held 0.872s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-aa105e38-6bf8-40d5-aecd-c5e061b50fba tempest-VolumeDependencyTests-81981976 None] Created reservations ['71822a69-07f0-4d5e-9295-3682190fa34d', '1e8f9c74-5c08-40a0-ac48-a4178df13134', 'edeee372-30aa-433d-97ae-a2b6c74d1c5c', 'b2c26c18-13b4-4a0d-a402-c4b9873591f0'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-aa105e38-6bf8-40d5-aecd-c5e061b50fba tempest-VolumeDependencyTests-81981976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-aa105e38-6bf8-40d5-aecd-c5e061b50fba tempest-VolumeDependencyTests-81981976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-aa105e38-6bf8-40d5-aecd-c5e061b50fba tempest-VolumeDependencyTests-81981976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-aa105e38-6bf8-40d5-aecd-c5e061b50fba tempest-VolumeDependencyTests-81981976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-aa105e38-6bf8-40d5-aecd-c5e061b50fba tempest-VolumeDependencyTests-81981976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-aa105e38-6bf8-40d5-aecd-c5e061b50fba tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:56 devstack sudo[88392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:40:56 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e3ffaafe-0de7-4c1b-9912-676776e4157d tempest-VolumeDependencyTests-81981976 None] Acquiring lock "cinder-d416111f-698e-45e1-82af-db2cf5d26fcd-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e3ffaafe-0de7-4c1b-9912-676776e4157d tempest-VolumeDependencyTests-81981976 None] Lock "cinder-d416111f-698e-45e1-82af-db2cf5d26fcd-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e3ffaafe-0de7-4c1b-9912-676776e4157d tempest-VolumeDependencyTests-81981976 None] Acquiring lock "cinder-quobyte-d416111f-698e-45e1-82af-db2cf5d26fcd" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e3ffaafe-0de7-4c1b-9912-676776e4157d tempest-VolumeDependencyTests-81981976 None] Lock "cinder-quobyte-d416111f-698e-45e1-82af-db2cf5d26fcd" acquired by "delete_volume" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac765648-f02b-4bdd-b643-5b461e7d4fc1]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e3ffaafe-0de7-4c1b-9912-676776e4157d tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d416111f-698e-45e1-82af-db2cf5d26fcd {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:56 devstack sudo[88394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d416111f-698e-45e1-82af-db2cf5d26fcd Apr 02 12:40:56 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Flow 'volume_create_manager' (d039cbe0-0578-495e-bace-20540c61b982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45d66802-1c4b-48d6-96e8-74d4698a9514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45d66802-1c4b-48d6-96e8-74d4698a9514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-315522980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bbf8a787-2474-4de3-b3e9-26059e794160,host='devstack@QuobyteHD#QuobyteHD',id=006b3890-2068-48be-89ea-c6499cec74f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772395a8a9224449891dabcd8ec0d482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:57Z,use_quota=True,user_id='05d864696a7f4971812274cabd066631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2cb9a3cd-efa8-4b5e-8c6d-0ba7da3de296),volume_type_id=2cb9a3cd-efa8-4b5e-8c6d-0ba7da3de296)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49533ff-a78e-4858-aae7-73175a31e3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49533ff-a78e-4858-aae7-73175a31e3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19a49b0c-def7-4bf9-b5d6-2613601910da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19a49b0c-def7-4bf9-b5d6-2613601910da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '006b3890-2068-48be-89ea-c6499cec74f7', 'volume_name': 'volume-006b3890-2068-48be-89ea-c6499cec74f7', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c07bef-e0e8-41be-83fb-ef4653a8db28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:56 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c07bef-e0e8-41be-83fb-ef4653a8db28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b86d27e-5e8a-4789-8c84-fd699434e1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:56 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Volume 006b3890-2068-48be-89ea-c6499cec74f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-006b3890-2068-48be-89ea-c6499cec74f7', 'volume_size': 1} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bbf8a787-2474-4de3-b3e9-26059e794160,created_at=2026-04-02T10:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-315522980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bbf8a787-2474-4de3-b3e9-26059e794160,host='devstack@QuobyteHD#QuobyteHD',id=006b3890-2068-48be-89ea-c6499cec74f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772395a8a9224449891dabcd8ec0d482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:40:57Z,use_quota=True,user_id='05d864696a7f4971812274cabd066631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2cb9a3cd-efa8-4b5e-8c6d-0ba7da3de296),volume_type_id=2cb9a3cd-efa8-4b5e-8c6d-0ba7da3de296)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Creating volume 006b3890-2068-48be-89ea-c6499cec74f7 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:40:56 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-aa105e38-6bf8-40d5-aecd-c5e061b50fba tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.506s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-aa105e38-6bf8-40d5-aecd-c5e061b50fba tempest-VolumeDependencyTests-81981976 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:40:56 devstack sudo[88397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7 1073741824 Apr 02 12:40:56 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:56 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-aa105e38-6bf8-40d5-aecd-c5e061b50fba tempest-VolumeDependencyTests-81981976 None] Deleted volume successfully. Apr 02 12:40:56 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-aa105e38-6bf8-40d5-aecd-c5e061b50fba tempest-VolumeDependencyTests-81981976 None] Lock "cinder-ec990be1-9031-4e38-a116-1dad21ab251c-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:57 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e3ffaafe-0de7-4c1b-9912-676776e4157d tempest-VolumeDependencyTests-81981976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d416111f-698e-45e1-82af-db2cf5d26fcd" returned: 0 in 0.509s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e3ffaafe-0de7-4c1b-9912-676776e4157d tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d416111f-698e-45e1-82af-db2cf5d26fcd {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:57 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d416111f-698e-45e1-82af-db2cf5d26fcd Apr 02 12:40:57 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:57 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7 1073741824" returned: 0 in 0.487s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:57 devstack sudo[88407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7 Apr 02 12:40:57 devstack sudo[88407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:57 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e3ffaafe-0de7-4c1b-9912-676776e4157d tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d416111f-698e-45e1-82af-db2cf5d26fcd" returned: 0 in 0.423s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:57 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e3ffaafe-0de7-4c1b-9912-676776e4157d tempest-VolumeDependencyTests-81981976 None] Lock "cinder-quobyte-d416111f-698e-45e1-82af-db2cf5d26fcd" released by "delete_volume" :: held 0.955s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:57 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-e3ffaafe-0de7-4c1b-9912-676776e4157d tempest-VolumeDependencyTests-81981976 None] Created reservations ['a37f30db-d185-4821-a11f-6f649e41d01e', '76736436-94f7-4ea3-a0a6-93786c882e59', '442ccac7-faa5-41a6-b74d-0d3c0767a165', '6064781d-70c1-4742-9290-141853b3d4e2'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:40:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e3ffaafe-0de7-4c1b-9912-676776e4157d tempest-VolumeDependencyTests-81981976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:40:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e3ffaafe-0de7-4c1b-9912-676776e4157d tempest-VolumeDependencyTests-81981976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:40:57 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e3ffaafe-0de7-4c1b-9912-676776e4157d tempest-VolumeDependencyTests-81981976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:40:57 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e3ffaafe-0de7-4c1b-9912-676776e4157d tempest-VolumeDependencyTests-81981976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:40:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e3ffaafe-0de7-4c1b-9912-676776e4157d tempest-VolumeDependencyTests-81981976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e3ffaafe-0de7-4c1b-9912-676776e4157d tempest-VolumeDependencyTests-81981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:40:57 devstack sudo[88411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:40:57 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:40:57 devstack sudo[88407]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7" returned: 0 in 0.437s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:57 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:40:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:40:57 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b86d27e-5e8a-4789-8c84-fd699434e1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-006b3890-2068-48be-89ea-c6499cec74f7', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:57 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19228db-6ded-4213-a81c-2c6d0c60bc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:40:57 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Volume volume-006b3890-2068-48be-89ea-c6499cec74f7 (006b3890-2068-48be-89ea-c6499cec74f7): created successfully Apr 02 12:40:57 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19228db-6ded-4213-a81c-2c6d0c60bc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:40:57 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Flow 'volume_create_manager' (d039cbe0-0578-495e-bace-20540c61b982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:40:57 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-9c7dc482-71d7-49bd-93a2-275dd034cb35 tempest-GroupSnapshotsTest-865490240 None] Created volume successfully. Apr 02 12:40:57 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root Apr 02 12:40:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e3ffaafe-0de7-4c1b-9912-676776e4157d tempest-VolumeDependencyTests-81981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.428s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:40:57 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-e3ffaafe-0de7-4c1b-9912-676776e4157d tempest-VolumeDependencyTests-81981976 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:40:57 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-e3ffaafe-0de7-4c1b-9912-676776e4157d tempest-VolumeDependencyTests-81981976 None] Deleted volume successfully. Apr 02 12:40:57 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e3ffaafe-0de7-4c1b-9912-676776e4157d tempest-VolumeDependencyTests-81981976 None] Lock "cinder-d416111f-698e-45e1-82af-db2cf5d26fcd-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:40:58 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-3152555a-9753-4271-85c9-584127fb223c tempest-GroupSnapshotsTest-865490240 None] Update group completed successfully. Apr 02 12:41:00 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-2eb2ce7a-9e1e-4822-99c1-378aefce3923 tempest-GroupSnapshotsTest-865490240 None] Update group completed successfully. Apr 02 12:41:01 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-21aa2d53-eeba-4015-a15e-c5d093f18ea2 tempest-GroupSnapshotsTest-865490240 None] Update group completed successfully. Apr 02 12:41:02 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-a512de09-1039-4359-9b30-ce0f916c37ca tempest-GroupSnapshotsTest-865490240 None] Update group completed successfully. Apr 02 12:41:03 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] GroupSnapshot 92cdf927-d0ef-451d-8cfd-bbed05cfd9a7: creating. Apr 02 12:41:03 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] Group snapshot 92cdf927-d0ef-451d-8cfd-bbed05cfd9a7: creating. {{(pid=82819) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 02 12:41:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:41:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:41:03 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] Creating offline snapshot 44ca8115-b299-4a88-8da5-64af1b859e3d of volume 006b3890-2068-48be-89ea-c6499cec74f7 {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:41:03 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[635f9d53-c075-4040-bc06-024b3688ed67]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:41:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:03 devstack sudo[88416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7 Apr 02 12:41:03 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:04 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7" returned: 0 in 0.427s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7.44ca8115-b299-4a88-8da5-64af1b859e3d 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:04 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7.44ca8115-b299-4a88-8da5-64af1b859e3d 1G Apr 02 12:41:04 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:04 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7.44ca8115-b299-4a88-8da5-64af1b859e3d 1G" returned: 0 in 0.455s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-006b3890-2068-48be-89ea-c6499cec74f7 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7.44ca8115-b299-4a88-8da5-64af1b859e3d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:04 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-006b3890-2068-48be-89ea-c6499cec74f7 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7.44ca8115-b299-4a88-8da5-64af1b859e3d Apr 02 12:41:04 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:04 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-006b3890-2068-48be-89ea-c6499cec74f7 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7.44ca8115-b299-4a88-8da5-64af1b859e3d" returned: 0 in 0.403s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:04 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7.44ca8115-b299-4a88-8da5-64af1b859e3d is being set with open permissions: ugo+rw: NotImplementedError Apr 02 12:41:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7.44ca8115-b299-4a88-8da5-64af1b859e3d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:04 devstack sudo[88431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7.44ca8115-b299-4a88-8da5-64af1b859e3d Apr 02 12:41:04 devstack sudo[88431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:05 devstack sudo[88431]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7.44ca8115-b299-4a88-8da5-64af1b859e3d" returned: 0 in 0.374s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:05 devstack sudo[88434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7.info Apr 02 12:41:05 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:05 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7.info" returned: 0 in 0.383s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:05 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7.info is being set with open permissions: ugo+rw: NotImplementedError Apr 02 12:41:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:05 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7.info Apr 02 12:41:05 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:06 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7.info" returned: 0 in 0.368s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.464s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:41:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:41:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:41:06 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] Creating offline snapshot d2dd55f0-06dd-4141-840c-52d4c4860402 of volume 1ecc586f-24fb-4b1d-8813-9813927010fe {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:41:06 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ce7a96-7084-4028-9096-b685c577dc24]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:41:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:06 devstack sudo[88440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe Apr 02 12:41:06 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:06 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe" returned: 0 in 0.440s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe.d2dd55f0-06dd-4141-840c-52d4c4860402 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:06 devstack sudo[88445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe.d2dd55f0-06dd-4141-840c-52d4c4860402 1G Apr 02 12:41:06 devstack sudo[88445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:07 devstack sudo[88445]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe.d2dd55f0-06dd-4141-840c-52d4c4860402 1G" returned: 0 in 0.435s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ecc586f-24fb-4b1d-8813-9813927010fe -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe.d2dd55f0-06dd-4141-840c-52d4c4860402 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:07 devstack sudo[88450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ecc586f-24fb-4b1d-8813-9813927010fe -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe.d2dd55f0-06dd-4141-840c-52d4c4860402 Apr 02 12:41:07 devstack sudo[88450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:07 devstack sudo[88450]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ecc586f-24fb-4b1d-8813-9813927010fe -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe.d2dd55f0-06dd-4141-840c-52d4c4860402" returned: 0 in 0.401s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:07 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe.d2dd55f0-06dd-4141-840c-52d4c4860402 is being set with open permissions: ugo+rw: NotImplementedError Apr 02 12:41:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe.d2dd55f0-06dd-4141-840c-52d4c4860402 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:07 devstack sudo[88455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe.d2dd55f0-06dd-4141-840c-52d4c4860402 Apr 02 12:41:07 devstack sudo[88455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:07 devstack sudo[88455]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe.d2dd55f0-06dd-4141-840c-52d4c4860402" returned: 0 in 0.406s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:07 devstack sudo[88459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe.info Apr 02 12:41:07 devstack sudo[88459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:08 devstack sudo[88459]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe.info" returned: 0 in 0.405s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:08 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe.info is being set with open permissions: ugo+rw: NotImplementedError Apr 02 12:41:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:08 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe.info Apr 02 12:41:08 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:08 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe.info" returned: 0 in 0.394s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.538s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:41:08 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-477efb55-be32-4f43-89b7-c4f14ed44ab2 tempest-GroupSnapshotsTest-865490240 None] group_snapshot 92cdf927-d0ef-451d-8cfd-bbed05cfd9a7: created successfully Apr 02 12:41:08 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] group_snapshot 92cdf927-d0ef-451d-8cfd-bbed05cfd9a7: deleting Apr 02 12:41:08 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] group_snapshot 92cdf927-d0ef-451d-8cfd-bbed05cfd9a7: deleting {{(pid=82819) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 02 12:41:08 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "cinder-quobyte-006b3890-2068-48be-89ea-c6499cec74f7" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:41:08 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-006b3890-2068-48be-89ea-c6499cec74f7" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:41:08 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "cinder-quobyte-44ca8115-b299-4a88-8da5-64af1b859e3d" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:41:08 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-44ca8115-b299-4a88-8da5-64af1b859e3d" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:41:08 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] Deleting offline snapshot 44ca8115-b299-4a88-8da5-64af1b859e3d of volume 006b3890-2068-48be-89ea-c6499cec74f7 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:41:08 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] snapshot_file for this snap is: volume-006b3890-2068-48be-89ea-c6499cec74f7.44ca8115-b299-4a88-8da5-64af1b859e3d {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:41:08 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea8d1a1-4ecc-499e-a87b-957b8c37a2f4]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:41:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7.44ca8115-b299-4a88-8da5-64af1b859e3d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:09 devstack sudo[88467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7.44ca8115-b299-4a88-8da5-64af1b859e3d Apr 02 12:41:09 devstack sudo[88467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:09 devstack sudo[88467]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7.44ca8115-b299-4a88-8da5-64af1b859e3d" returned: 0 in 0.462s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:09 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-006b3890-2068-48be-89ea-c6499cec74f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:41:09 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b84e551-403e-4f80-9d9e-be84b78f7287]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:41:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:09 devstack sudo[88472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7 Apr 02 12:41:09 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:09 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7" returned: 0 in 0.460s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7.44ca8115-b299-4a88-8da5-64af1b859e3d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:09 devstack sudo[88477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7.44ca8115-b299-4a88-8da5-64af1b859e3d Apr 02 12:41:09 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:10 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7.44ca8115-b299-4a88-8da5-64af1b859e3d" returned: 0 in 0.415s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7.44ca8115-b299-4a88-8da5-64af1b859e3d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:10 devstack sudo[88482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7.44ca8115-b299-4a88-8da5-64af1b859e3d Apr 02 12:41:10 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:10 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7.44ca8115-b299-4a88-8da5-64af1b859e3d" returned: 0 in 0.370s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:10 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-44ca8115-b299-4a88-8da5-64af1b859e3d" released by "_delete_snapshot" :: held 1.754s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:41:10 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-006b3890-2068-48be-89ea-c6499cec74f7" released by "delete_snapshot" :: held 1.768s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:41:10 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "cinder-quobyte-1ecc586f-24fb-4b1d-8813-9813927010fe" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:41:10 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-1ecc586f-24fb-4b1d-8813-9813927010fe" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:41:10 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "cinder-quobyte-d2dd55f0-06dd-4141-840c-52d4c4860402" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:41:10 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-d2dd55f0-06dd-4141-840c-52d4c4860402" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:41:10 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] Deleting offline snapshot d2dd55f0-06dd-4141-840c-52d4c4860402 of volume 1ecc586f-24fb-4b1d-8813-9813927010fe {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:41:10 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] snapshot_file for this snap is: volume-1ecc586f-24fb-4b1d-8813-9813927010fe.d2dd55f0-06dd-4141-840c-52d4c4860402 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:41:10 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbf0ef7-a59e-4500-9cea-0af0091e88fa]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:41:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe.d2dd55f0-06dd-4141-840c-52d4c4860402 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:10 devstack sudo[88485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe.d2dd55f0-06dd-4141-840c-52d4c4860402 Apr 02 12:41:10 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:11 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe.d2dd55f0-06dd-4141-840c-52d4c4860402" returned: 0 in 0.449s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:11 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ecc586f-24fb-4b1d-8813-9813927010fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:41:11 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eaf58bc-31b0-4809-95fe-2173c1530706]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:41:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:11 devstack sudo[88490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe Apr 02 12:41:11 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:11 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe" returned: 0 in 0.472s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe.d2dd55f0-06dd-4141-840c-52d4c4860402 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:11 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe.d2dd55f0-06dd-4141-840c-52d4c4860402 Apr 02 12:41:11 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:12 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe.d2dd55f0-06dd-4141-840c-52d4c4860402" returned: 0 in 0.417s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe.d2dd55f0-06dd-4141-840c-52d4c4860402 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:12 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe.d2dd55f0-06dd-4141-840c-52d4c4860402 Apr 02 12:41:12 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:12 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe.d2dd55f0-06dd-4141-840c-52d4c4860402" returned: 0 in 0.396s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:12 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-d2dd55f0-06dd-4141-840c-52d4c4860402" released by "_delete_snapshot" :: held 1.780s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:41:12 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-1ecc586f-24fb-4b1d-8813-9813927010fe" released by "delete_snapshot" :: held 1.791s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:41:12 devstack cinder-volume[82819]: WARNING cinder.quota [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1992980559 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1992980559, it is now deprecated. Please use the default quota class for default quota. Apr 02 12:41:12 devstack cinder-volume[82819]: WARNING cinder.quota [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1992980559 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1992980559, it is now deprecated. Please use the default quota class for default quota. Apr 02 12:41:12 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] Created reservations ['849e6ef8-d426-4304-b714-6c563bdbd865', 'd8c1d219-8b0b-45d5-8886-138eeb06ea5d', '5d60ef45-66c2-42be-aedf-2181ca842a94', '5d0778f7-bce5-40a9-9b6f-0a1a166e0eee'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:41:12 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] Created reservations ['9c809c72-3b6f-4bde-b122-2fade5859b54', '82af441e-4b47-48de-80ab-a6824c968095', 'e3e73abe-21c3-4416-80c9-3bef940f4c03', 'd76cc5d0-8f88-43cc-8acb-c4fb16f152a6'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:41:12 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-d6e63c2f-84b3-41af-8b55-7bb35e4e68bb tempest-GroupSnapshotsTest-865490240 None] group_snapshot 92cdf927-d0ef-451d-8cfd-bbed05cfd9a7: deleted successfully Apr 02 12:41:13 devstack cinder-volume[82819]: DEBUG oslo_service.periodic_task [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82819) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 12:41:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:41:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:41:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:41:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:41:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:41:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:13 devstack sudo[88503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:41:13 devstack sudo[88503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:13 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-cb2a1f04-4a09-4d38-aadc-9e5831761b7d tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "cinder-quobyte-006b3890-2068-48be-89ea-c6499cec74f7" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:41:13 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-cb2a1f04-4a09-4d38-aadc-9e5831761b7d tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-006b3890-2068-48be-89ea-c6499cec74f7" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:41:13 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f037326-2a91-4780-abc4-01c2afd1ba08]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:41:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cb2a1f04-4a09-4d38-aadc-9e5831761b7d tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:13 devstack sudo[88505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7 Apr 02 12:41:13 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:13 devstack sudo[88503]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.456s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:13 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:41:13 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cb2a1f04-4a09-4d38-aadc-9e5831761b7d tempest-GroupSnapshotsTest-865490240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7" returned: 0 in 0.481s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cb2a1f04-4a09-4d38-aadc-9e5831761b7d tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:13 devstack sudo[88511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7 Apr 02 12:41:13 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:14 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cb2a1f04-4a09-4d38-aadc-9e5831761b7d tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-006b3890-2068-48be-89ea-c6499cec74f7" returned: 0 in 0.375s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:14 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-cb2a1f04-4a09-4d38-aadc-9e5831761b7d tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-006b3890-2068-48be-89ea-c6499cec74f7" released by "delete_volume" :: held 0.886s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:41:14 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-cb2a1f04-4a09-4d38-aadc-9e5831761b7d tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "cinder-quobyte-1ecc586f-24fb-4b1d-8813-9813927010fe" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:41:14 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-cb2a1f04-4a09-4d38-aadc-9e5831761b7d tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-1ecc586f-24fb-4b1d-8813-9813927010fe" acquired by "delete_volume" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:41:14 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[c205def4-f5bf-42c5-ada1-55205bacba7a]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:41:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cb2a1f04-4a09-4d38-aadc-9e5831761b7d tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:14 devstack sudo[88514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe Apr 02 12:41:14 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:14 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cb2a1f04-4a09-4d38-aadc-9e5831761b7d tempest-GroupSnapshotsTest-865490240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe" returned: 0 in 0.453s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cb2a1f04-4a09-4d38-aadc-9e5831761b7d tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:14 devstack sudo[88519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe Apr 02 12:41:14 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:15 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cb2a1f04-4a09-4d38-aadc-9e5831761b7d tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1ecc586f-24fb-4b1d-8813-9813927010fe" returned: 0 in 0.381s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:15 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-cb2a1f04-4a09-4d38-aadc-9e5831761b7d tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-1ecc586f-24fb-4b1d-8813-9813927010fe" released by "delete_volume" :: held 0.862s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:41:15 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-cb2a1f04-4a09-4d38-aadc-9e5831761b7d tempest-GroupSnapshotsTest-865490240 None] Created reservations ['491daec9-19a3-4154-8578-223010ded09f'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:41:15 devstack cinder-volume[82819]: WARNING cinder.quota [None req-cb2a1f04-4a09-4d38-aadc-9e5831761b7d tempest-GroupSnapshotsTest-865490240 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1992980559 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1992980559, it is now deprecated. Please use the default quota class for default quota. Apr 02 12:41:15 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-cb2a1f04-4a09-4d38-aadc-9e5831761b7d tempest-GroupSnapshotsTest-865490240 None] Created reservations ['2d04139f-47fa-4c58-b089-afe1fba1ac0b', 'c64b1500-17df-441a-a0bc-06ee5505860b', '1484e098-72ca-4f77-be25-69e0a7606d2a', '71e36b10-3b61-4b9b-9503-f5d5d338d835'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:41:15 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-cb2a1f04-4a09-4d38-aadc-9e5831761b7d tempest-GroupSnapshotsTest-865490240 None] Created reservations ['b32a2d58-0ee1-42f4-8ddc-749ed6099712', 'a1b30c0e-f72e-41bb-8e20-9f0776c77945', 'faf0245b-bd39-465c-be47-1d8e63cbc04e', '05c4489f-f7dc-4573-8abd-56d37ef8afbe'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:41:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cb2a1f04-4a09-4d38-aadc-9e5831761b7d tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:41:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cb2a1f04-4a09-4d38-aadc-9e5831761b7d tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:41:15 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cb2a1f04-4a09-4d38-aadc-9e5831761b7d tempest-GroupSnapshotsTest-865490240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:41:15 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cb2a1f04-4a09-4d38-aadc-9e5831761b7d tempest-GroupSnapshotsTest-865490240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:41:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cb2a1f04-4a09-4d38-aadc-9e5831761b7d tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:41:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cb2a1f04-4a09-4d38-aadc-9e5831761b7d tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:15 devstack sudo[88522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:41:15 devstack sudo[88522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:15 devstack sudo[88522]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cb2a1f04-4a09-4d38-aadc-9e5831761b7d tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.417s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:15 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-cb2a1f04-4a09-4d38-aadc-9e5831761b7d tempest-GroupSnapshotsTest-865490240 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:41:15 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-cb2a1f04-4a09-4d38-aadc-9e5831761b7d tempest-GroupSnapshotsTest-865490240 None] Delete group completed successfully. Apr 02 12:41:15 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-6895facf-ebd4-4406-b41e-0cc743570543 tempest-GroupSnapshotsTest-865490240 None] Group tempest-GroupSnapshotsTest-Group-1666690865: creating Apr 02 12:41:15 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-6895facf-ebd4-4406-b41e-0cc743570543 tempest-GroupSnapshotsTest-865490240 None] Group tempest-GroupSnapshotsTest-Group-1666690865: created successfully Apr 02 12:41:15 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-6895facf-ebd4-4406-b41e-0cc743570543 tempest-GroupSnapshotsTest-865490240 None] Create group completed successfully. Apr 02 12:41:17 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:41:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Flow 'volume_create_manager' (579a8e41-744c-4dd3-a232-05bb0bae2d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:41:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (192ca111-a827-4a07-b419-1c0ac277bc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:41:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (192ca111-a827-4a07-b419-1c0ac277bc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-32641003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=70326ec8-a853-41e5-84b1-63fd5acc7173,host='devstack@QuobyteHD#QuobyteHD',id=2ac62675-b962-4e39-8c71-539863cb73f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772395a8a9224449891dabcd8ec0d482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:41:17Z,use_quota=True,user_id='05d864696a7f4971812274cabd066631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27895d41-4019-4f16-ac1a-c6156dc78ee2),volume_type_id=27895d41-4019-4f16-ac1a-c6156dc78ee2)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:41:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c61eb0f-4874-4d35-8e2d-948c5e76ae4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:41:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c61eb0f-4874-4d35-8e2d-948c5e76ae4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:41:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c8d53be-4c90-4553-90b3-5f3512d5ec5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:41:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c8d53be-4c90-4553-90b3-5f3512d5ec5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ac62675-b962-4e39-8c71-539863cb73f9', 'volume_name': 'volume-2ac62675-b962-4e39-8c71-539863cb73f9', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:41:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46fa287d-c446-46ba-97c3-6d80e71ac328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:41:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46fa287d-c446-46ba-97c3-6d80e71ac328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:41:17 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad6380a-7dac-4aed-a26d-67fc16a44b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:41:17 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Volume 2ac62675-b962-4e39-8c71-539863cb73f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ac62675-b962-4e39-8c71-539863cb73f9', 'volume_size': 1} Apr 02 12:41:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:41:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:41:17 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=70326ec8-a853-41e5-84b1-63fd5acc7173,created_at=2026-04-02T10:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-32641003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=70326ec8-a853-41e5-84b1-63fd5acc7173,host='devstack@QuobyteHD#QuobyteHD',id=2ac62675-b962-4e39-8c71-539863cb73f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772395a8a9224449891dabcd8ec0d482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:41:17Z,use_quota=True,user_id='05d864696a7f4971812274cabd066631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27895d41-4019-4f16-ac1a-c6156dc78ee2),volume_type_id=27895d41-4019-4f16-ac1a-c6156dc78ee2)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:41:17 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Creating volume 2ac62675-b962-4e39-8c71-539863cb73f9 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:41:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:41:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:41:17 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:41:17 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:41:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:41:17 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:41:17 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:41:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:17 devstack sudo[88525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9 1073741824 Apr 02 12:41:17 devstack sudo[88525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:17 devstack sudo[88525]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9 1073741824" returned: 0 in 0.506s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:17 devstack sudo[88531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9 Apr 02 12:41:17 devstack sudo[88531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:18 devstack sudo[88531]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9" returned: 0 in 0.395s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:18 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:41:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:41:18 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad6380a-7dac-4aed-a26d-67fc16a44b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ac62675-b962-4e39-8c71-539863cb73f9', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:41:18 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ec3db9e-f1c9-4301-aa4d-a2e291d0a8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:41:18 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Volume volume-2ac62675-b962-4e39-8c71-539863cb73f9 (2ac62675-b962-4e39-8c71-539863cb73f9): created successfully Apr 02 12:41:18 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ec3db9e-f1c9-4301-aa4d-a2e291d0a8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:41:18 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Flow 'volume_create_manager' (579a8e41-744c-4dd3-a232-05bb0bae2d50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:41:18 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-ee967b3f-e8d5-4605-ba87-fa25ae0e391e tempest-GroupSnapshotsTest-865490240 None] Created volume successfully. Apr 02 12:41:19 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-eb2fe778-c951-4912-bad4-9cc6f9431879 tempest-GroupSnapshotsTest-865490240 None] GroupSnapshot a5e34dd5-c370-411f-bc9d-01ba7cc64600: creating. Apr 02 12:41:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-eb2fe778-c951-4912-bad4-9cc6f9431879 tempest-GroupSnapshotsTest-865490240 None] Group snapshot a5e34dd5-c370-411f-bc9d-01ba7cc64600: creating. {{(pid=82819) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 02 12:41:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-eb2fe778-c951-4912-bad4-9cc6f9431879 tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:41:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-eb2fe778-c951-4912-bad4-9cc6f9431879 tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:41:19 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-eb2fe778-c951-4912-bad4-9cc6f9431879 tempest-GroupSnapshotsTest-865490240 None] Creating offline snapshot 6d328182-2271-4a58-a3d7-fe9e5ba8c9d3 of volume 2ac62675-b962-4e39-8c71-539863cb73f9 {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:41:19 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef0e6d9-312b-4925-95a1-5920fe694689]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:41:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-eb2fe778-c951-4912-bad4-9cc6f9431879 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:19 devstack sudo[88534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9 Apr 02 12:41:19 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:20 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-eb2fe778-c951-4912-bad4-9cc6f9431879 tempest-GroupSnapshotsTest-865490240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9" returned: 0 in 0.471s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-eb2fe778-c951-4912-bad4-9cc6f9431879 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9.6d328182-2271-4a58-a3d7-fe9e5ba8c9d3 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:20 devstack sudo[88539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9.6d328182-2271-4a58-a3d7-fe9e5ba8c9d3 1G Apr 02 12:41:20 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:20 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-eb2fe778-c951-4912-bad4-9cc6f9431879 tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9.6d328182-2271-4a58-a3d7-fe9e5ba8c9d3 1G" returned: 0 in 0.494s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-eb2fe778-c951-4912-bad4-9cc6f9431879 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ac62675-b962-4e39-8c71-539863cb73f9 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9.6d328182-2271-4a58-a3d7-fe9e5ba8c9d3 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:20 devstack sudo[88544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ac62675-b962-4e39-8c71-539863cb73f9 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9.6d328182-2271-4a58-a3d7-fe9e5ba8c9d3 Apr 02 12:41:20 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:20 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-eb2fe778-c951-4912-bad4-9cc6f9431879 tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ac62675-b962-4e39-8c71-539863cb73f9 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9.6d328182-2271-4a58-a3d7-fe9e5ba8c9d3" returned: 0 in 0.464s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:20 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-eb2fe778-c951-4912-bad4-9cc6f9431879 tempest-GroupSnapshotsTest-865490240 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9.6d328182-2271-4a58-a3d7-fe9e5ba8c9d3 is being set with open permissions: ugo+rw: NotImplementedError Apr 02 12:41:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-eb2fe778-c951-4912-bad4-9cc6f9431879 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9.6d328182-2271-4a58-a3d7-fe9e5ba8c9d3 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:21 devstack sudo[88549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9.6d328182-2271-4a58-a3d7-fe9e5ba8c9d3 Apr 02 12:41:21 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:21 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-eb2fe778-c951-4912-bad4-9cc6f9431879 tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9.6d328182-2271-4a58-a3d7-fe9e5ba8c9d3" returned: 0 in 0.392s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-eb2fe778-c951-4912-bad4-9cc6f9431879 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:21 devstack sudo[88552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9.info Apr 02 12:41:21 devstack sudo[88552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:21 devstack sudo[88552]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-eb2fe778-c951-4912-bad4-9cc6f9431879 tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9.info" returned: 0 in 0.391s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:21 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-eb2fe778-c951-4912-bad4-9cc6f9431879 tempest-GroupSnapshotsTest-865490240 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9.info is being set with open permissions: ugo+rw: NotImplementedError Apr 02 12:41:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-eb2fe778-c951-4912-bad4-9cc6f9431879 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:21 devstack sudo[88555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9.info Apr 02 12:41:21 devstack sudo[88555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:22 devstack sudo[88555]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-eb2fe778-c951-4912-bad4-9cc6f9431879 tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9.info" returned: 0 in 0.382s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-eb2fe778-c951-4912-bad4-9cc6f9431879 tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.653s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:41:22 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-eb2fe778-c951-4912-bad4-9cc6f9431879 tempest-GroupSnapshotsTest-865490240 None] group_snapshot a5e34dd5-c370-411f-bc9d-01ba7cc64600: created successfully Apr 02 12:41:22 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-249267ee-a011-4492-8475-fab25d3f3963 tempest-GroupSnapshotsTest-865490240 None] group_snapshot a5e34dd5-c370-411f-bc9d-01ba7cc64600: deleting Apr 02 12:41:22 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-249267ee-a011-4492-8475-fab25d3f3963 tempest-GroupSnapshotsTest-865490240 None] group_snapshot a5e34dd5-c370-411f-bc9d-01ba7cc64600: deleting {{(pid=82819) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 02 12:41:22 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-249267ee-a011-4492-8475-fab25d3f3963 tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "cinder-quobyte-2ac62675-b962-4e39-8c71-539863cb73f9" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:41:22 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-249267ee-a011-4492-8475-fab25d3f3963 tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-2ac62675-b962-4e39-8c71-539863cb73f9" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:41:22 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-249267ee-a011-4492-8475-fab25d3f3963 tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "cinder-quobyte-6d328182-2271-4a58-a3d7-fe9e5ba8c9d3" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:41:22 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-249267ee-a011-4492-8475-fab25d3f3963 tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-6d328182-2271-4a58-a3d7-fe9e5ba8c9d3" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:41:22 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-249267ee-a011-4492-8475-fab25d3f3963 tempest-GroupSnapshotsTest-865490240 None] Deleting offline snapshot 6d328182-2271-4a58-a3d7-fe9e5ba8c9d3 of volume 2ac62675-b962-4e39-8c71-539863cb73f9 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:41:22 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-249267ee-a011-4492-8475-fab25d3f3963 tempest-GroupSnapshotsTest-865490240 None] snapshot_file for this snap is: volume-2ac62675-b962-4e39-8c71-539863cb73f9.6d328182-2271-4a58-a3d7-fe9e5ba8c9d3 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:41:22 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd687723-aeab-43c8-b3f9-043993600c59]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:41:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-249267ee-a011-4492-8475-fab25d3f3963 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9.6d328182-2271-4a58-a3d7-fe9e5ba8c9d3 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:22 devstack sudo[88558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9.6d328182-2271-4a58-a3d7-fe9e5ba8c9d3 Apr 02 12:41:22 devstack sudo[88558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:23 devstack sudo[88558]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-249267ee-a011-4492-8475-fab25d3f3963 tempest-GroupSnapshotsTest-865490240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9.6d328182-2271-4a58-a3d7-fe9e5ba8c9d3" returned: 0 in 0.506s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:23 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-249267ee-a011-4492-8475-fab25d3f3963 tempest-GroupSnapshotsTest-865490240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ac62675-b962-4e39-8c71-539863cb73f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:41:23 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0947e49-59f8-47c5-ac5a-0b1e2b5722ad]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:41:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-249267ee-a011-4492-8475-fab25d3f3963 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:23 devstack sudo[88563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9 Apr 02 12:41:23 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:23 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-249267ee-a011-4492-8475-fab25d3f3963 tempest-GroupSnapshotsTest-865490240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9" returned: 0 in 0.533s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-249267ee-a011-4492-8475-fab25d3f3963 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9.6d328182-2271-4a58-a3d7-fe9e5ba8c9d3 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:23 devstack sudo[88568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9.6d328182-2271-4a58-a3d7-fe9e5ba8c9d3 Apr 02 12:41:23 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:24 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-249267ee-a011-4492-8475-fab25d3f3963 tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9.6d328182-2271-4a58-a3d7-fe9e5ba8c9d3" returned: 0 in 0.454s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-249267ee-a011-4492-8475-fab25d3f3963 tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9.6d328182-2271-4a58-a3d7-fe9e5ba8c9d3 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:24 devstack sudo[88573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9.6d328182-2271-4a58-a3d7-fe9e5ba8c9d3 Apr 02 12:41:24 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:24 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-249267ee-a011-4492-8475-fab25d3f3963 tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9.6d328182-2271-4a58-a3d7-fe9e5ba8c9d3" returned: 0 in 0.418s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:24 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-249267ee-a011-4492-8475-fab25d3f3963 tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-6d328182-2271-4a58-a3d7-fe9e5ba8c9d3" released by "_delete_snapshot" :: held 1.970s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:41:24 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-249267ee-a011-4492-8475-fab25d3f3963 tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-2ac62675-b962-4e39-8c71-539863cb73f9" released by "delete_snapshot" :: held 1.985s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:41:24 devstack cinder-volume[82819]: WARNING cinder.quota [None req-249267ee-a011-4492-8475-fab25d3f3963 tempest-GroupSnapshotsTest-865490240 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1221541480 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1221541480, it is now deprecated. Please use the default quota class for default quota. Apr 02 12:41:24 devstack cinder-volume[82819]: WARNING cinder.quota [None req-249267ee-a011-4492-8475-fab25d3f3963 tempest-GroupSnapshotsTest-865490240 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1221541480 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1221541480, it is now deprecated. Please use the default quota class for default quota. Apr 02 12:41:24 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-249267ee-a011-4492-8475-fab25d3f3963 tempest-GroupSnapshotsTest-865490240 None] Created reservations ['b177ce86-2a05-4491-b954-a119fca64561', '1a9aff8f-f579-4ae7-abff-4966210c517b', 'deabc832-475c-4f37-8d0e-f99a423d75a0', 'c7fb593e-ad7b-4826-a1c0-32f2846984ef'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:41:24 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-249267ee-a011-4492-8475-fab25d3f3963 tempest-GroupSnapshotsTest-865490240 None] group_snapshot a5e34dd5-c370-411f-bc9d-01ba7cc64600: deleted successfully Apr 02 12:41:25 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-efab96ec-9b81-43e1-a581-b65e0a1b991b tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "cinder-quobyte-2ac62675-b962-4e39-8c71-539863cb73f9" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:41:25 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-efab96ec-9b81-43e1-a581-b65e0a1b991b tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-2ac62675-b962-4e39-8c71-539863cb73f9" acquired by "delete_volume" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:41:25 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[3572338a-3e77-4221-aab2-a31048abfcf8]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:41:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-efab96ec-9b81-43e1-a581-b65e0a1b991b tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:25 devstack sudo[88576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9 Apr 02 12:41:25 devstack sudo[88576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:25 devstack sudo[88576]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-efab96ec-9b81-43e1-a581-b65e0a1b991b tempest-GroupSnapshotsTest-865490240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9" returned: 0 in 0.491s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-efab96ec-9b81-43e1-a581-b65e0a1b991b tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:25 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9 Apr 02 12:41:25 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:26 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-efab96ec-9b81-43e1-a581-b65e0a1b991b tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-2ac62675-b962-4e39-8c71-539863cb73f9" returned: 0 in 0.402s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:26 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-efab96ec-9b81-43e1-a581-b65e0a1b991b tempest-GroupSnapshotsTest-865490240 None] Lock "cinder-quobyte-2ac62675-b962-4e39-8c71-539863cb73f9" released by "delete_volume" :: held 0.922s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:41:26 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-efab96ec-9b81-43e1-a581-b65e0a1b991b tempest-GroupSnapshotsTest-865490240 None] Created reservations ['983b647c-6a68-4292-ab43-d16a954ecd33'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:41:26 devstack cinder-volume[82819]: WARNING cinder.quota [None req-efab96ec-9b81-43e1-a581-b65e0a1b991b tempest-GroupSnapshotsTest-865490240 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1221541480 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1221541480, it is now deprecated. Please use the default quota class for default quota. Apr 02 12:41:26 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-efab96ec-9b81-43e1-a581-b65e0a1b991b tempest-GroupSnapshotsTest-865490240 None] Created reservations ['ecb305fc-a960-4ba9-87a0-bd157b8f5761', '8c1d01bb-ac84-4aa8-80b9-6ec0357a5c86', '9185ee08-5c61-432e-89e0-2c874c95dfa3', '90d076e6-e0dd-4606-ad3f-478b9ab72a0c'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:41:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-efab96ec-9b81-43e1-a581-b65e0a1b991b tempest-GroupSnapshotsTest-865490240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:41:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-efab96ec-9b81-43e1-a581-b65e0a1b991b tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:41:26 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-efab96ec-9b81-43e1-a581-b65e0a1b991b tempest-GroupSnapshotsTest-865490240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:41:26 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-efab96ec-9b81-43e1-a581-b65e0a1b991b tempest-GroupSnapshotsTest-865490240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:41:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-efab96ec-9b81-43e1-a581-b65e0a1b991b tempest-GroupSnapshotsTest-865490240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:41:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-efab96ec-9b81-43e1-a581-b65e0a1b991b tempest-GroupSnapshotsTest-865490240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:26 devstack sudo[88584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:41:26 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:26 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-efab96ec-9b81-43e1-a581-b65e0a1b991b tempest-GroupSnapshotsTest-865490240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.466s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:26 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-efab96ec-9b81-43e1-a581-b65e0a1b991b tempest-GroupSnapshotsTest-865490240 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:41:26 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-efab96ec-9b81-43e1-a581-b65e0a1b991b tempest-GroupSnapshotsTest-865490240 None] Delete group completed successfully. Apr 02 12:41:29 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:41:29 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Flow 'volume_create_manager' (62ad33d8-a56e-4b61-bf00-8b6fa876d502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:41:29 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c8a0ed3-e6cc-4111-9d02-1f87304b8aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:41:29 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c8a0ed3-e6cc-4111-9d02-1f87304b8aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1914643174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=401dd639-a868-4632-9d5f-b2584ea7528f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d2587c1a92c4126b386fa10d633b082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:41:29Z,use_quota=True,user_id='e3221567ed174e9aa16b21370a037849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:41:29 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bfa84f-ef6b-4b96-b270-b3ecc31cb744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:41:29 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bfa84f-ef6b-4b96-b270-b3ecc31cb744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:41:29 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc73b72-9b94-4dc7-96b7-45dd7e3a2102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:41:29 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc73b72-9b94-4dc7-96b7-45dd7e3a2102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '401dd639-a868-4632-9d5f-b2584ea7528f', 'volume_name': 'volume-401dd639-a868-4632-9d5f-b2584ea7528f', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:41:29 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c669b1f-71d7-4a69-9857-0e8b8be43f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:41:29 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c669b1f-71d7-4a69-9857-0e8b8be43f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:41:29 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7e9ba0-405e-46ca-9d1d-cea4c3c9a58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:41:29 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Volume 401dd639-a868-4632-9d5f-b2584ea7528f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-401dd639-a868-4632-9d5f-b2584ea7528f', 'volume_size': 1} Apr 02 12:41:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:41:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:41:29 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1914643174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=401dd639-a868-4632-9d5f-b2584ea7528f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d2587c1a92c4126b386fa10d633b082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:41:29Z,use_quota=True,user_id='e3221567ed174e9aa16b21370a037849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:41:29 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Creating volume 401dd639-a868-4632-9d5f-b2584ea7528f {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:41:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:41:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:41:29 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:41:29 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:41:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:41:29 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:41:29 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:41:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:29 devstack sudo[88588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f 1073741824 Apr 02 12:41:29 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:29 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f 1073741824" returned: 0 in 0.477s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:29 devstack sudo[88593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f Apr 02 12:41:29 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:30 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f" returned: 0 in 0.406s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:30 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:41:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:41:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7e9ba0-405e-46ca-9d1d-cea4c3c9a58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-401dd639-a868-4632-9d5f-b2584ea7528f', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:41:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c450c75-5d8f-4ad0-acca-71fe474fa2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:41:30 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Volume volume-401dd639-a868-4632-9d5f-b2584ea7528f (401dd639-a868-4632-9d5f-b2584ea7528f): created successfully Apr 02 12:41:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c450c75-5d8f-4ad0-acca-71fe474fa2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:41:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Flow 'volume_create_manager' (62ad33d8-a56e-4b61-bf00-8b6fa876d502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:41:30 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-da3cb899-986c-47e1-8024-534a3b0e454c tempest-SnapshotsActionsTest-610139172 None] Created volume successfully. Apr 02 12:41:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0c9e923f-3365-4692-9216-15993dd48fb8 tempest-SnapshotsActionsTest-610139172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:41:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0c9e923f-3365-4692-9216-15993dd48fb8 tempest-SnapshotsActionsTest-610139172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:41:31 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-0c9e923f-3365-4692-9216-15993dd48fb8 tempest-SnapshotsActionsTest-610139172 None] Creating offline snapshot d69f97e5-433b-4014-bcdc-ee8195544ea5 of volume 401dd639-a868-4632-9d5f-b2584ea7528f {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:41:31 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b81bb06-16ed-4978-877a-6d8dbf3ad12d]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:41:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0c9e923f-3365-4692-9216-15993dd48fb8 tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:31 devstack sudo[88596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f Apr 02 12:41:31 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:32 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0c9e923f-3365-4692-9216-15993dd48fb8 tempest-SnapshotsActionsTest-610139172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f" returned: 0 in 0.481s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0c9e923f-3365-4692-9216-15993dd48fb8 tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:32 devstack sudo[88601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 1G Apr 02 12:41:32 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:32 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0c9e923f-3365-4692-9216-15993dd48fb8 tempest-SnapshotsActionsTest-610139172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 1G" returned: 0 in 0.473s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0c9e923f-3365-4692-9216-15993dd48fb8 tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-401dd639-a868-4632-9d5f-b2584ea7528f -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:32 devstack sudo[88606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-401dd639-a868-4632-9d5f-b2584ea7528f -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 Apr 02 12:41:32 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:32 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0c9e923f-3365-4692-9216-15993dd48fb8 tempest-SnapshotsActionsTest-610139172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-401dd639-a868-4632-9d5f-b2584ea7528f -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5" returned: 0 in 0.456s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:32 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-0c9e923f-3365-4692-9216-15993dd48fb8 tempest-SnapshotsActionsTest-610139172 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 is being set with open permissions: ugo+rw Apr 02 12:41:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0c9e923f-3365-4692-9216-15993dd48fb8 tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:33 devstack sudo[88611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 Apr 02 12:41:33 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:33 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0c9e923f-3365-4692-9216-15993dd48fb8 tempest-SnapshotsActionsTest-610139172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5" returned: 0 in 0.432s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0c9e923f-3365-4692-9216-15993dd48fb8 tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:33 devstack sudo[88614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.info Apr 02 12:41:33 devstack sudo[88614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:33 devstack sudo[88614]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0c9e923f-3365-4692-9216-15993dd48fb8 tempest-SnapshotsActionsTest-610139172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.info" returned: 0 in 0.468s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:33 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-0c9e923f-3365-4692-9216-15993dd48fb8 tempest-SnapshotsActionsTest-610139172 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.info is being set with open permissions: ugo+rw Apr 02 12:41:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0c9e923f-3365-4692-9216-15993dd48fb8 tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:33 devstack sudo[88617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.info Apr 02 12:41:33 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:34 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0c9e923f-3365-4692-9216-15993dd48fb8 tempest-SnapshotsActionsTest-610139172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.info" returned: 0 in 0.407s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0c9e923f-3365-4692-9216-15993dd48fb8 tempest-SnapshotsActionsTest-610139172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.784s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:41:34 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-0c9e923f-3365-4692-9216-15993dd48fb8 tempest-SnapshotsActionsTest-610139172 None] Create snapshot completed successfully Apr 02 12:41:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-bb4cad1d-cf38-4efe-bb64-a9a3d151b5de tempest-SnapshotsActionsTest-610139172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:41:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-bb4cad1d-cf38-4efe-bb64-a9a3d151b5de tempest-SnapshotsActionsTest-610139172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:41:35 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-bb4cad1d-cf38-4efe-bb64-a9a3d151b5de tempest-SnapshotsActionsTest-610139172 None] Creating offline snapshot b1fa9771-769a-468e-9615-7986e5deda44 of volume 401dd639-a868-4632-9d5f-b2584ea7528f {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:41:35 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7763669c-e2a8-4f56-adb8-27b468348d64]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:41:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bb4cad1d-cf38-4efe-bb64-a9a3d151b5de tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:35 devstack sudo[88620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 Apr 02 12:41:35 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:35 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bb4cad1d-cf38-4efe-bb64-a9a3d151b5de tempest-SnapshotsActionsTest-610139172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5" returned: 0 in 0.507s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:35 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-bb4cad1d-cf38-4efe-bb64-a9a3d151b5de tempest-SnapshotsActionsTest-610139172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-401dd639-a868-4632-9d5f-b2584ea7528f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:41:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bb4cad1d-cf38-4efe-bb64-a9a3d151b5de tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.b1fa9771-769a-468e-9615-7986e5deda44 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:35 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.b1fa9771-769a-468e-9615-7986e5deda44 1G Apr 02 12:41:35 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:36 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bb4cad1d-cf38-4efe-bb64-a9a3d151b5de tempest-SnapshotsActionsTest-610139172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.b1fa9771-769a-468e-9615-7986e5deda44 1G" returned: 0 in 0.550s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bb4cad1d-cf38-4efe-bb64-a9a3d151b5de tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.b1fa9771-769a-468e-9615-7986e5deda44 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:36 devstack sudo[88630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.b1fa9771-769a-468e-9615-7986e5deda44 Apr 02 12:41:36 devstack sudo[88630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:36 devstack sudo[88630]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bb4cad1d-cf38-4efe-bb64-a9a3d151b5de tempest-SnapshotsActionsTest-610139172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.b1fa9771-769a-468e-9615-7986e5deda44" returned: 0 in 0.451s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:36 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-bb4cad1d-cf38-4efe-bb64-a9a3d151b5de tempest-SnapshotsActionsTest-610139172 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.b1fa9771-769a-468e-9615-7986e5deda44 is being set with open permissions: ugo+rw Apr 02 12:41:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bb4cad1d-cf38-4efe-bb64-a9a3d151b5de tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.b1fa9771-769a-468e-9615-7986e5deda44 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:36 devstack sudo[88635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.b1fa9771-769a-468e-9615-7986e5deda44 Apr 02 12:41:36 devstack sudo[88635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:36 devstack sudo[88635]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bb4cad1d-cf38-4efe-bb64-a9a3d151b5de tempest-SnapshotsActionsTest-610139172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.b1fa9771-769a-468e-9615-7986e5deda44" returned: 0 in 0.409s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-bb4cad1d-cf38-4efe-bb64-a9a3d151b5de tempest-SnapshotsActionsTest-610139172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.973s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:41:37 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-bb4cad1d-cf38-4efe-bb64-a9a3d151b5de tempest-SnapshotsActionsTest-610139172 None] Create snapshot completed successfully Apr 02 12:41:37 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f714f950-d9a0-4df9-af76-64bdc2ea10e4 tempest-SnapshotsActionsTest-149850220 None] Acquiring lock "cinder-b1fa9771-769a-468e-9615-7986e5deda44-delete_snapshot" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:41:37 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f714f950-d9a0-4df9-af76-64bdc2ea10e4 tempest-SnapshotsActionsTest-149850220 None] Lock "cinder-b1fa9771-769a-468e-9615-7986e5deda44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:41:37 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f714f950-d9a0-4df9-af76-64bdc2ea10e4 tempest-SnapshotsActionsTest-149850220 None] Acquiring lock "cinder-quobyte-401dd639-a868-4632-9d5f-b2584ea7528f" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:41:37 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f714f950-d9a0-4df9-af76-64bdc2ea10e4 tempest-SnapshotsActionsTest-149850220 None] Lock "cinder-quobyte-401dd639-a868-4632-9d5f-b2584ea7528f" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:41:37 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f714f950-d9a0-4df9-af76-64bdc2ea10e4 tempest-SnapshotsActionsTest-149850220 None] Acquiring lock "cinder-quobyte-b1fa9771-769a-468e-9615-7986e5deda44" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:41:37 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f714f950-d9a0-4df9-af76-64bdc2ea10e4 tempest-SnapshotsActionsTest-149850220 None] Lock "cinder-quobyte-b1fa9771-769a-468e-9615-7986e5deda44" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:41:37 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-f714f950-d9a0-4df9-af76-64bdc2ea10e4 tempest-SnapshotsActionsTest-149850220 None] Deleting offline snapshot b1fa9771-769a-468e-9615-7986e5deda44 of volume 401dd639-a868-4632-9d5f-b2584ea7528f {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:41:37 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-f714f950-d9a0-4df9-af76-64bdc2ea10e4 tempest-SnapshotsActionsTest-149850220 None] snapshot_file for this snap is: volume-401dd639-a868-4632-9d5f-b2584ea7528f.b1fa9771-769a-468e-9615-7986e5deda44 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:41:37 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed97655-92e0-454f-aa40-88fde963cb18]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:41:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f714f950-d9a0-4df9-af76-64bdc2ea10e4 tempest-SnapshotsActionsTest-149850220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.b1fa9771-769a-468e-9615-7986e5deda44 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:37 devstack sudo[88638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.b1fa9771-769a-468e-9615-7986e5deda44 Apr 02 12:41:37 devstack sudo[88638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:37 devstack sudo[88638]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f714f950-d9a0-4df9-af76-64bdc2ea10e4 tempest-SnapshotsActionsTest-149850220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.b1fa9771-769a-468e-9615-7986e5deda44" returned: 0 in 0.466s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:37 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-f714f950-d9a0-4df9-af76-64bdc2ea10e4 tempest-SnapshotsActionsTest-149850220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-401dd639-a868-4632-9d5f-b2584ea7528f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:41:37 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccc487b-f202-4626-93d2-6b5b97e12098]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:41:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f714f950-d9a0-4df9-af76-64bdc2ea10e4 tempest-SnapshotsActionsTest-149850220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:37 devstack sudo[88644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 Apr 02 12:41:37 devstack sudo[88644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:38 devstack sudo[88644]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f714f950-d9a0-4df9-af76-64bdc2ea10e4 tempest-SnapshotsActionsTest-149850220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5" returned: 0 in 0.453s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-f714f950-d9a0-4df9-af76-64bdc2ea10e4 tempest-SnapshotsActionsTest-149850220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-401dd639-a868-4632-9d5f-b2584ea7528f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:41:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f714f950-d9a0-4df9-af76-64bdc2ea10e4 tempest-SnapshotsActionsTest-149850220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.b1fa9771-769a-468e-9615-7986e5deda44 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:38 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.b1fa9771-769a-468e-9615-7986e5deda44 Apr 02 12:41:38 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:38 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f714f950-d9a0-4df9-af76-64bdc2ea10e4 tempest-SnapshotsActionsTest-149850220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.b1fa9771-769a-468e-9615-7986e5deda44" returned: 0 in 0.482s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f714f950-d9a0-4df9-af76-64bdc2ea10e4 tempest-SnapshotsActionsTest-149850220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.b1fa9771-769a-468e-9615-7986e5deda44 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:38 devstack sudo[88654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.b1fa9771-769a-468e-9615-7986e5deda44 Apr 02 12:41:38 devstack sudo[88654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:39 devstack sudo[88654]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f714f950-d9a0-4df9-af76-64bdc2ea10e4 tempest-SnapshotsActionsTest-149850220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.b1fa9771-769a-468e-9615-7986e5deda44" returned: 0 in 0.399s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:39 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f714f950-d9a0-4df9-af76-64bdc2ea10e4 tempest-SnapshotsActionsTest-149850220 None] Lock "cinder-quobyte-b1fa9771-769a-468e-9615-7986e5deda44" released by "_delete_snapshot" :: held 1.862s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:41:39 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f714f950-d9a0-4df9-af76-64bdc2ea10e4 tempest-SnapshotsActionsTest-149850220 None] Lock "cinder-quobyte-401dd639-a868-4632-9d5f-b2584ea7528f" released by "delete_snapshot" :: held 1.878s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:41:39 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-f714f950-d9a0-4df9-af76-64bdc2ea10e4 tempest-SnapshotsActionsTest-149850220 None] Created reservations ['a2878d1f-b498-4445-b800-bf0bbf9c1354', '35943090-516d-45f7-b2cf-bab935546352', '2078dce5-e797-4245-b90f-c9762c9c3c13', '53512c96-1706-434b-8e9e-deb67973ea4a'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:41:39 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-f714f950-d9a0-4df9-af76-64bdc2ea10e4 tempest-SnapshotsActionsTest-149850220 None] Delete snapshot completed successfully. Apr 02 12:41:39 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f714f950-d9a0-4df9-af76-64bdc2ea10e4 tempest-SnapshotsActionsTest-149850220 None] Lock "cinder-b1fa9771-769a-468e-9615-7986e5deda44-delete_snapshot" released by "delete_snapshot" :: held 1.990s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:41:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-82f300bf-b11b-426e-9e12-f5f5911cdc55 tempest-SnapshotsActionsTest-610139172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:41:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-82f300bf-b11b-426e-9e12-f5f5911cdc55 tempest-SnapshotsActionsTest-610139172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:41:39 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-82f300bf-b11b-426e-9e12-f5f5911cdc55 tempest-SnapshotsActionsTest-610139172 None] Creating offline snapshot e5a0eedc-ab8e-45ba-8597-59f3f3a4e812 of volume 401dd639-a868-4632-9d5f-b2584ea7528f {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:41:39 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fceb7c-9641-4d7b-aa48-263f393c2332]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:41:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-82f300bf-b11b-426e-9e12-f5f5911cdc55 tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:39 devstack sudo[88657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 Apr 02 12:41:39 devstack sudo[88657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:40 devstack sudo[88657]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-82f300bf-b11b-426e-9e12-f5f5911cdc55 tempest-SnapshotsActionsTest-610139172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5" returned: 0 in 0.475s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:40 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-82f300bf-b11b-426e-9e12-f5f5911cdc55 tempest-SnapshotsActionsTest-610139172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-401dd639-a868-4632-9d5f-b2584ea7528f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:41:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-82f300bf-b11b-426e-9e12-f5f5911cdc55 tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.e5a0eedc-ab8e-45ba-8597-59f3f3a4e812 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:40 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.e5a0eedc-ab8e-45ba-8597-59f3f3a4e812 1G Apr 02 12:41:40 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:40 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-82f300bf-b11b-426e-9e12-f5f5911cdc55 tempest-SnapshotsActionsTest-610139172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.e5a0eedc-ab8e-45ba-8597-59f3f3a4e812 1G" returned: 0 in 0.645s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-82f300bf-b11b-426e-9e12-f5f5911cdc55 tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.e5a0eedc-ab8e-45ba-8597-59f3f3a4e812 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:40 devstack sudo[88667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.e5a0eedc-ab8e-45ba-8597-59f3f3a4e812 Apr 02 12:41:40 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:41 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-82f300bf-b11b-426e-9e12-f5f5911cdc55 tempest-SnapshotsActionsTest-610139172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.e5a0eedc-ab8e-45ba-8597-59f3f3a4e812" returned: 0 in 0.437s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:41 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-82f300bf-b11b-426e-9e12-f5f5911cdc55 tempest-SnapshotsActionsTest-610139172 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.e5a0eedc-ab8e-45ba-8597-59f3f3a4e812 is being set with open permissions: ugo+rw Apr 02 12:41:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-82f300bf-b11b-426e-9e12-f5f5911cdc55 tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.e5a0eedc-ab8e-45ba-8597-59f3f3a4e812 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:41 devstack sudo[88672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.e5a0eedc-ab8e-45ba-8597-59f3f3a4e812 Apr 02 12:41:41 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:41 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-82f300bf-b11b-426e-9e12-f5f5911cdc55 tempest-SnapshotsActionsTest-610139172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.e5a0eedc-ab8e-45ba-8597-59f3f3a4e812" returned: 0 in 0.425s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-82f300bf-b11b-426e-9e12-f5f5911cdc55 tempest-SnapshotsActionsTest-610139172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.045s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:41:41 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-82f300bf-b11b-426e-9e12-f5f5911cdc55 tempest-SnapshotsActionsTest-610139172 None] Create snapshot completed successfully Apr 02 12:41:42 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a85f12ea-f74b-47c9-88f8-d9912c319f4c tempest-SnapshotsActionsTest-149850220 None] Acquiring lock "cinder-e5a0eedc-ab8e-45ba-8597-59f3f3a4e812-delete_snapshot" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:41:42 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a85f12ea-f74b-47c9-88f8-d9912c319f4c tempest-SnapshotsActionsTest-149850220 None] Lock "cinder-e5a0eedc-ab8e-45ba-8597-59f3f3a4e812-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:41:42 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a85f12ea-f74b-47c9-88f8-d9912c319f4c tempest-SnapshotsActionsTest-149850220 None] Acquiring lock "cinder-quobyte-401dd639-a868-4632-9d5f-b2584ea7528f" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:41:42 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a85f12ea-f74b-47c9-88f8-d9912c319f4c tempest-SnapshotsActionsTest-149850220 None] Lock "cinder-quobyte-401dd639-a868-4632-9d5f-b2584ea7528f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:41:42 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a85f12ea-f74b-47c9-88f8-d9912c319f4c tempest-SnapshotsActionsTest-149850220 None] Acquiring lock "cinder-quobyte-e5a0eedc-ab8e-45ba-8597-59f3f3a4e812" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:41:42 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a85f12ea-f74b-47c9-88f8-d9912c319f4c tempest-SnapshotsActionsTest-149850220 None] Lock "cinder-quobyte-e5a0eedc-ab8e-45ba-8597-59f3f3a4e812" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:41:42 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-a85f12ea-f74b-47c9-88f8-d9912c319f4c tempest-SnapshotsActionsTest-149850220 None] Deleting offline snapshot e5a0eedc-ab8e-45ba-8597-59f3f3a4e812 of volume 401dd639-a868-4632-9d5f-b2584ea7528f {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:41:42 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-a85f12ea-f74b-47c9-88f8-d9912c319f4c tempest-SnapshotsActionsTest-149850220 None] snapshot_file for this snap is: volume-401dd639-a868-4632-9d5f-b2584ea7528f.e5a0eedc-ab8e-45ba-8597-59f3f3a4e812 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:41:42 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbff8e1e-4a56-4f76-a422-b787d0ba5413]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:41:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a85f12ea-f74b-47c9-88f8-d9912c319f4c tempest-SnapshotsActionsTest-149850220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.e5a0eedc-ab8e-45ba-8597-59f3f3a4e812 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:42 devstack sudo[88681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.e5a0eedc-ab8e-45ba-8597-59f3f3a4e812 Apr 02 12:41:42 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:43 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a85f12ea-f74b-47c9-88f8-d9912c319f4c tempest-SnapshotsActionsTest-149850220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.e5a0eedc-ab8e-45ba-8597-59f3f3a4e812" returned: 0 in 0.493s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:43 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-a85f12ea-f74b-47c9-88f8-d9912c319f4c tempest-SnapshotsActionsTest-149850220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-401dd639-a868-4632-9d5f-b2584ea7528f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:41:43 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40663f8-1510-4c57-b30d-a7fcfb9cc1cc]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:41:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a85f12ea-f74b-47c9-88f8-d9912c319f4c tempest-SnapshotsActionsTest-149850220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:43 devstack sudo[88686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 Apr 02 12:41:43 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:43 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a85f12ea-f74b-47c9-88f8-d9912c319f4c tempest-SnapshotsActionsTest-149850220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5" returned: 0 in 0.452s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:43 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-a85f12ea-f74b-47c9-88f8-d9912c319f4c tempest-SnapshotsActionsTest-149850220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-401dd639-a868-4632-9d5f-b2584ea7528f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:41:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a85f12ea-f74b-47c9-88f8-d9912c319f4c tempest-SnapshotsActionsTest-149850220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.e5a0eedc-ab8e-45ba-8597-59f3f3a4e812 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:43 devstack sudo[88691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.e5a0eedc-ab8e-45ba-8597-59f3f3a4e812 Apr 02 12:41:43 devstack sudo[88691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:44 devstack sudo[88691]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a85f12ea-f74b-47c9-88f8-d9912c319f4c tempest-SnapshotsActionsTest-149850220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.e5a0eedc-ab8e-45ba-8597-59f3f3a4e812" returned: 0 in 0.447s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a85f12ea-f74b-47c9-88f8-d9912c319f4c tempest-SnapshotsActionsTest-149850220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.e5a0eedc-ab8e-45ba-8597-59f3f3a4e812 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:44 devstack sudo[88696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.e5a0eedc-ab8e-45ba-8597-59f3f3a4e812 Apr 02 12:41:44 devstack sudo[88696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:44 devstack sudo[88696]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a85f12ea-f74b-47c9-88f8-d9912c319f4c tempest-SnapshotsActionsTest-149850220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.e5a0eedc-ab8e-45ba-8597-59f3f3a4e812" returned: 0 in 0.387s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a85f12ea-f74b-47c9-88f8-d9912c319f4c tempest-SnapshotsActionsTest-149850220 None] Lock "cinder-quobyte-e5a0eedc-ab8e-45ba-8597-59f3f3a4e812" released by "_delete_snapshot" :: held 1.833s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:41:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a85f12ea-f74b-47c9-88f8-d9912c319f4c tempest-SnapshotsActionsTest-149850220 None] Lock "cinder-quobyte-401dd639-a868-4632-9d5f-b2584ea7528f" released by "delete_snapshot" :: held 1.851s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:41:44 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-a85f12ea-f74b-47c9-88f8-d9912c319f4c tempest-SnapshotsActionsTest-149850220 None] Created reservations ['9ac65c6f-2481-4a55-8b74-7a08f9a1a2bb', 'b7f6c834-f298-40fe-82a2-657c4f1a9fb4', 'b0895250-e568-4021-a1d6-6c4c91970a2d', 'fd45c50c-f9e4-4d8f-af71-35e5fdf750b9'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:41:44 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-a85f12ea-f74b-47c9-88f8-d9912c319f4c tempest-SnapshotsActionsTest-149850220 None] Delete snapshot completed successfully. Apr 02 12:41:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a85f12ea-f74b-47c9-88f8-d9912c319f4c tempest-SnapshotsActionsTest-149850220 None] Lock "cinder-e5a0eedc-ab8e-45ba-8597-59f3f3a4e812-delete_snapshot" released by "delete_snapshot" :: held 1.940s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:41:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-f171d4bf-58d9-4b45-b4c1-0ee616caa17d tempest-SnapshotsActionsTest-610139172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:41:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-f171d4bf-58d9-4b45-b4c1-0ee616caa17d tempest-SnapshotsActionsTest-610139172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:41:45 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-f171d4bf-58d9-4b45-b4c1-0ee616caa17d tempest-SnapshotsActionsTest-610139172 None] Creating offline snapshot f5936648-a843-4997-a2a0-945ad9f22549 of volume 401dd639-a868-4632-9d5f-b2584ea7528f {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:41:45 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4433a22-e460-46b1-a586-b6b8475547b8]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:41:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f171d4bf-58d9-4b45-b4c1-0ee616caa17d tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:45 devstack sudo[88699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 Apr 02 12:41:45 devstack sudo[88699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:45 devstack sudo[88699]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f171d4bf-58d9-4b45-b4c1-0ee616caa17d tempest-SnapshotsActionsTest-610139172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5" returned: 0 in 0.502s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:45 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-f171d4bf-58d9-4b45-b4c1-0ee616caa17d tempest-SnapshotsActionsTest-610139172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-401dd639-a868-4632-9d5f-b2584ea7528f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:41:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f171d4bf-58d9-4b45-b4c1-0ee616caa17d tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.f5936648-a843-4997-a2a0-945ad9f22549 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:45 devstack sudo[88704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.f5936648-a843-4997-a2a0-945ad9f22549 1G Apr 02 12:41:45 devstack sudo[88704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:46 devstack sudo[88704]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f171d4bf-58d9-4b45-b4c1-0ee616caa17d tempest-SnapshotsActionsTest-610139172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.f5936648-a843-4997-a2a0-945ad9f22549 1G" returned: 0 in 0.528s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f171d4bf-58d9-4b45-b4c1-0ee616caa17d tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.f5936648-a843-4997-a2a0-945ad9f22549 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:46 devstack sudo[88709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.f5936648-a843-4997-a2a0-945ad9f22549 Apr 02 12:41:46 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:46 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f171d4bf-58d9-4b45-b4c1-0ee616caa17d tempest-SnapshotsActionsTest-610139172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.f5936648-a843-4997-a2a0-945ad9f22549" returned: 0 in 0.441s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:46 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-f171d4bf-58d9-4b45-b4c1-0ee616caa17d tempest-SnapshotsActionsTest-610139172 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.f5936648-a843-4997-a2a0-945ad9f22549 is being set with open permissions: ugo+rw Apr 02 12:41:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f171d4bf-58d9-4b45-b4c1-0ee616caa17d tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.f5936648-a843-4997-a2a0-945ad9f22549 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:46 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.f5936648-a843-4997-a2a0-945ad9f22549 Apr 02 12:41:46 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:47 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f171d4bf-58d9-4b45-b4c1-0ee616caa17d tempest-SnapshotsActionsTest-610139172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.f5936648-a843-4997-a2a0-945ad9f22549" returned: 0 in 0.408s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-f171d4bf-58d9-4b45-b4c1-0ee616caa17d tempest-SnapshotsActionsTest-610139172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.944s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:41:47 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-f171d4bf-58d9-4b45-b4c1-0ee616caa17d tempest-SnapshotsActionsTest-610139172 None] Create snapshot completed successfully Apr 02 12:41:47 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-8bb8a410-0595-4749-8824-cb02e211d139 tempest-SnapshotsActionsTest-149850220 None] Acquiring lock "cinder-f5936648-a843-4997-a2a0-945ad9f22549-delete_snapshot" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:41:47 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-8bb8a410-0595-4749-8824-cb02e211d139 tempest-SnapshotsActionsTest-149850220 None] Lock "cinder-f5936648-a843-4997-a2a0-945ad9f22549-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:41:47 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-8bb8a410-0595-4749-8824-cb02e211d139 tempest-SnapshotsActionsTest-149850220 None] Acquiring lock "cinder-quobyte-401dd639-a868-4632-9d5f-b2584ea7528f" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:41:47 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-8bb8a410-0595-4749-8824-cb02e211d139 tempest-SnapshotsActionsTest-149850220 None] Lock "cinder-quobyte-401dd639-a868-4632-9d5f-b2584ea7528f" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:41:47 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-8bb8a410-0595-4749-8824-cb02e211d139 tempest-SnapshotsActionsTest-149850220 None] Acquiring lock "cinder-quobyte-f5936648-a843-4997-a2a0-945ad9f22549" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:41:47 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-8bb8a410-0595-4749-8824-cb02e211d139 tempest-SnapshotsActionsTest-149850220 None] Lock "cinder-quobyte-f5936648-a843-4997-a2a0-945ad9f22549" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:41:47 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-8bb8a410-0595-4749-8824-cb02e211d139 tempest-SnapshotsActionsTest-149850220 None] Deleting offline snapshot f5936648-a843-4997-a2a0-945ad9f22549 of volume 401dd639-a868-4632-9d5f-b2584ea7528f {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:41:47 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-8bb8a410-0595-4749-8824-cb02e211d139 tempest-SnapshotsActionsTest-149850220 None] snapshot_file for this snap is: volume-401dd639-a868-4632-9d5f-b2584ea7528f.f5936648-a843-4997-a2a0-945ad9f22549 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:41:47 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb5445a-1e81-46d3-8164-7740a17f08e8]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:41:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8bb8a410-0595-4749-8824-cb02e211d139 tempest-SnapshotsActionsTest-149850220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.f5936648-a843-4997-a2a0-945ad9f22549 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:47 devstack sudo[88717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.f5936648-a843-4997-a2a0-945ad9f22549 Apr 02 12:41:47 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:47 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8bb8a410-0595-4749-8824-cb02e211d139 tempest-SnapshotsActionsTest-149850220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.f5936648-a843-4997-a2a0-945ad9f22549" returned: 0 in 0.497s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:47 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-8bb8a410-0595-4749-8824-cb02e211d139 tempest-SnapshotsActionsTest-149850220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-401dd639-a868-4632-9d5f-b2584ea7528f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:41:47 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b660f0-0718-4e75-bc5f-a6e09e7de3da]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:41:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8bb8a410-0595-4749-8824-cb02e211d139 tempest-SnapshotsActionsTest-149850220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:47 devstack sudo[88723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 Apr 02 12:41:47 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:48 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8bb8a410-0595-4749-8824-cb02e211d139 tempest-SnapshotsActionsTest-149850220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5" returned: 0 in 0.512s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:48 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-8bb8a410-0595-4749-8824-cb02e211d139 tempest-SnapshotsActionsTest-149850220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-401dd639-a868-4632-9d5f-b2584ea7528f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:41:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8bb8a410-0595-4749-8824-cb02e211d139 tempest-SnapshotsActionsTest-149850220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.f5936648-a843-4997-a2a0-945ad9f22549 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:48 devstack sudo[88728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.f5936648-a843-4997-a2a0-945ad9f22549 Apr 02 12:41:48 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:48 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8bb8a410-0595-4749-8824-cb02e211d139 tempest-SnapshotsActionsTest-149850220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.f5936648-a843-4997-a2a0-945ad9f22549" returned: 0 in 0.500s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8bb8a410-0595-4749-8824-cb02e211d139 tempest-SnapshotsActionsTest-149850220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.f5936648-a843-4997-a2a0-945ad9f22549 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:48 devstack sudo[88733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.f5936648-a843-4997-a2a0-945ad9f22549 Apr 02 12:41:48 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:49 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8bb8a410-0595-4749-8824-cb02e211d139 tempest-SnapshotsActionsTest-149850220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.f5936648-a843-4997-a2a0-945ad9f22549" returned: 0 in 0.389s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:49 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-8bb8a410-0595-4749-8824-cb02e211d139 tempest-SnapshotsActionsTest-149850220 None] Lock "cinder-quobyte-f5936648-a843-4997-a2a0-945ad9f22549" released by "_delete_snapshot" :: held 1.946s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:41:49 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-8bb8a410-0595-4749-8824-cb02e211d139 tempest-SnapshotsActionsTest-149850220 None] Lock "cinder-quobyte-401dd639-a868-4632-9d5f-b2584ea7528f" released by "delete_snapshot" :: held 1.960s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:41:49 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-8bb8a410-0595-4749-8824-cb02e211d139 tempest-SnapshotsActionsTest-149850220 None] Created reservations ['07b43fd0-a567-4d50-9dd7-b5bd0ac8f79f', '9271490d-a924-45a5-b566-83669042f330', '39ffd7c5-3448-40a0-8cec-6490672bf85b', '74cc2369-9059-4333-8ce0-ab8eae94fd49'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:41:49 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-8bb8a410-0595-4749-8824-cb02e211d139 tempest-SnapshotsActionsTest-149850220 None] Delete snapshot completed successfully. Apr 02 12:41:49 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-8bb8a410-0595-4749-8824-cb02e211d139 tempest-SnapshotsActionsTest-149850220 None] Lock "cinder-f5936648-a843-4997-a2a0-945ad9f22549-delete_snapshot" released by "delete_snapshot" :: held 2.058s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:41:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-956cd54c-1e50-46f2-8fa1-89c491dae339 tempest-SnapshotsActionsTest-610139172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:41:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-956cd54c-1e50-46f2-8fa1-89c491dae339 tempest-SnapshotsActionsTest-610139172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:41:49 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-956cd54c-1e50-46f2-8fa1-89c491dae339 tempest-SnapshotsActionsTest-610139172 None] Creating offline snapshot 753c1b7a-4067-4d9e-92f3-38a06bb06cf2 of volume 401dd639-a868-4632-9d5f-b2584ea7528f {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:41:49 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7296d449-67f4-4f15-99df-a3c994fb8fa0]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:41:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-956cd54c-1e50-46f2-8fa1-89c491dae339 tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:49 devstack sudo[88736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 Apr 02 12:41:49 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:50 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-956cd54c-1e50-46f2-8fa1-89c491dae339 tempest-SnapshotsActionsTest-610139172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5" returned: 0 in 0.446s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-956cd54c-1e50-46f2-8fa1-89c491dae339 tempest-SnapshotsActionsTest-610139172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-401dd639-a868-4632-9d5f-b2584ea7528f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:41:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-956cd54c-1e50-46f2-8fa1-89c491dae339 tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.753c1b7a-4067-4d9e-92f3-38a06bb06cf2 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:50 devstack sudo[88741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.753c1b7a-4067-4d9e-92f3-38a06bb06cf2 1G Apr 02 12:41:50 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:50 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-956cd54c-1e50-46f2-8fa1-89c491dae339 tempest-SnapshotsActionsTest-610139172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.753c1b7a-4067-4d9e-92f3-38a06bb06cf2 1G" returned: 0 in 0.473s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-956cd54c-1e50-46f2-8fa1-89c491dae339 tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.753c1b7a-4067-4d9e-92f3-38a06bb06cf2 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:50 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.753c1b7a-4067-4d9e-92f3-38a06bb06cf2 Apr 02 12:41:50 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:51 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-956cd54c-1e50-46f2-8fa1-89c491dae339 tempest-SnapshotsActionsTest-610139172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.753c1b7a-4067-4d9e-92f3-38a06bb06cf2" returned: 0 in 0.410s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:51 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-956cd54c-1e50-46f2-8fa1-89c491dae339 tempest-SnapshotsActionsTest-610139172 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.753c1b7a-4067-4d9e-92f3-38a06bb06cf2 is being set with open permissions: ugo+rw Apr 02 12:41:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-956cd54c-1e50-46f2-8fa1-89c491dae339 tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.753c1b7a-4067-4d9e-92f3-38a06bb06cf2 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:51 devstack sudo[88751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.753c1b7a-4067-4d9e-92f3-38a06bb06cf2 Apr 02 12:41:51 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:51 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-956cd54c-1e50-46f2-8fa1-89c491dae339 tempest-SnapshotsActionsTest-610139172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.753c1b7a-4067-4d9e-92f3-38a06bb06cf2" returned: 0 in 0.379s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-956cd54c-1e50-46f2-8fa1-89c491dae339 tempest-SnapshotsActionsTest-610139172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.762s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:41:51 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-956cd54c-1e50-46f2-8fa1-89c491dae339 tempest-SnapshotsActionsTest-610139172 None] Create snapshot completed successfully Apr 02 12:41:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6b81f537-21b1-4e3a-a91d-a2e9f216fdd2 tempest-SnapshotsActionsTest-149850220 None] Acquiring lock "cinder-753c1b7a-4067-4d9e-92f3-38a06bb06cf2-delete_snapshot" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:41:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6b81f537-21b1-4e3a-a91d-a2e9f216fdd2 tempest-SnapshotsActionsTest-149850220 None] Lock "cinder-753c1b7a-4067-4d9e-92f3-38a06bb06cf2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:41:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6b81f537-21b1-4e3a-a91d-a2e9f216fdd2 tempest-SnapshotsActionsTest-149850220 None] Acquiring lock "cinder-quobyte-401dd639-a868-4632-9d5f-b2584ea7528f" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:41:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6b81f537-21b1-4e3a-a91d-a2e9f216fdd2 tempest-SnapshotsActionsTest-149850220 None] Lock "cinder-quobyte-401dd639-a868-4632-9d5f-b2584ea7528f" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:41:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6b81f537-21b1-4e3a-a91d-a2e9f216fdd2 tempest-SnapshotsActionsTest-149850220 None] Acquiring lock "cinder-quobyte-753c1b7a-4067-4d9e-92f3-38a06bb06cf2" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:41:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6b81f537-21b1-4e3a-a91d-a2e9f216fdd2 tempest-SnapshotsActionsTest-149850220 None] Lock "cinder-quobyte-753c1b7a-4067-4d9e-92f3-38a06bb06cf2" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:41:51 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-6b81f537-21b1-4e3a-a91d-a2e9f216fdd2 tempest-SnapshotsActionsTest-149850220 None] Deleting offline snapshot 753c1b7a-4067-4d9e-92f3-38a06bb06cf2 of volume 401dd639-a868-4632-9d5f-b2584ea7528f {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:41:51 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-6b81f537-21b1-4e3a-a91d-a2e9f216fdd2 tempest-SnapshotsActionsTest-149850220 None] snapshot_file for this snap is: volume-401dd639-a868-4632-9d5f-b2584ea7528f.753c1b7a-4067-4d9e-92f3-38a06bb06cf2 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:41:51 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b067326-ec77-4c1a-aa25-167b80740498]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:41:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6b81f537-21b1-4e3a-a91d-a2e9f216fdd2 tempest-SnapshotsActionsTest-149850220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.753c1b7a-4067-4d9e-92f3-38a06bb06cf2 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:51 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.753c1b7a-4067-4d9e-92f3-38a06bb06cf2 Apr 02 12:41:51 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:52 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6b81f537-21b1-4e3a-a91d-a2e9f216fdd2 tempest-SnapshotsActionsTest-149850220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.753c1b7a-4067-4d9e-92f3-38a06bb06cf2" returned: 0 in 0.449s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:52 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-6b81f537-21b1-4e3a-a91d-a2e9f216fdd2 tempest-SnapshotsActionsTest-149850220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-401dd639-a868-4632-9d5f-b2584ea7528f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:41:52 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9e0e28-e470-41e5-9224-4c4b32a8ab42]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:41:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6b81f537-21b1-4e3a-a91d-a2e9f216fdd2 tempest-SnapshotsActionsTest-149850220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:52 devstack sudo[88759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 Apr 02 12:41:52 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:52 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6b81f537-21b1-4e3a-a91d-a2e9f216fdd2 tempest-SnapshotsActionsTest-149850220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5" returned: 0 in 0.469s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:52 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-6b81f537-21b1-4e3a-a91d-a2e9f216fdd2 tempest-SnapshotsActionsTest-149850220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-401dd639-a868-4632-9d5f-b2584ea7528f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:41:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6b81f537-21b1-4e3a-a91d-a2e9f216fdd2 tempest-SnapshotsActionsTest-149850220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.753c1b7a-4067-4d9e-92f3-38a06bb06cf2 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:52 devstack sudo[88764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.753c1b7a-4067-4d9e-92f3-38a06bb06cf2 Apr 02 12:41:52 devstack sudo[88764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:53 devstack sudo[88764]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6b81f537-21b1-4e3a-a91d-a2e9f216fdd2 tempest-SnapshotsActionsTest-149850220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.753c1b7a-4067-4d9e-92f3-38a06bb06cf2" returned: 0 in 0.456s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6b81f537-21b1-4e3a-a91d-a2e9f216fdd2 tempest-SnapshotsActionsTest-149850220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.753c1b7a-4067-4d9e-92f3-38a06bb06cf2 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:53 devstack sudo[88769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.753c1b7a-4067-4d9e-92f3-38a06bb06cf2 Apr 02 12:41:53 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:53 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6b81f537-21b1-4e3a-a91d-a2e9f216fdd2 tempest-SnapshotsActionsTest-149850220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.753c1b7a-4067-4d9e-92f3-38a06bb06cf2" returned: 0 in 0.403s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:53 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6b81f537-21b1-4e3a-a91d-a2e9f216fdd2 tempest-SnapshotsActionsTest-149850220 None] Lock "cinder-quobyte-753c1b7a-4067-4d9e-92f3-38a06bb06cf2" released by "_delete_snapshot" :: held 1.834s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:41:53 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6b81f537-21b1-4e3a-a91d-a2e9f216fdd2 tempest-SnapshotsActionsTest-149850220 None] Lock "cinder-quobyte-401dd639-a868-4632-9d5f-b2584ea7528f" released by "delete_snapshot" :: held 1.846s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:41:53 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-6b81f537-21b1-4e3a-a91d-a2e9f216fdd2 tempest-SnapshotsActionsTest-149850220 None] Created reservations ['820fdedd-3b4a-4fa2-9c46-507b5ad87d54', '6293c8c4-fbb9-48e3-b80f-b5f5c43fb8d6', '68487416-3383-4028-b73c-f28936bb23b2', '2bd63c4f-e56e-47d1-bacc-6857f163cbec'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:41:53 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-6b81f537-21b1-4e3a-a91d-a2e9f216fdd2 tempest-SnapshotsActionsTest-149850220 None] Delete snapshot completed successfully. Apr 02 12:41:53 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6b81f537-21b1-4e3a-a91d-a2e9f216fdd2 tempest-SnapshotsActionsTest-149850220 None] Lock "cinder-753c1b7a-4067-4d9e-92f3-38a06bb06cf2-delete_snapshot" released by "delete_snapshot" :: held 1.935s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:41:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b5811802-d5ae-478c-aa7a-b17d8d5f96de tempest-SnapshotsActionsTest-610139172 None] Acquiring lock "cinder-d69f97e5-433b-4014-bcdc-ee8195544ea5-delete_snapshot" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:41:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b5811802-d5ae-478c-aa7a-b17d8d5f96de tempest-SnapshotsActionsTest-610139172 None] Lock "cinder-d69f97e5-433b-4014-bcdc-ee8195544ea5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:41:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b5811802-d5ae-478c-aa7a-b17d8d5f96de tempest-SnapshotsActionsTest-610139172 None] Acquiring lock "cinder-quobyte-401dd639-a868-4632-9d5f-b2584ea7528f" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:41:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b5811802-d5ae-478c-aa7a-b17d8d5f96de tempest-SnapshotsActionsTest-610139172 None] Lock "cinder-quobyte-401dd639-a868-4632-9d5f-b2584ea7528f" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:41:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b5811802-d5ae-478c-aa7a-b17d8d5f96de tempest-SnapshotsActionsTest-610139172 None] Acquiring lock "cinder-quobyte-d69f97e5-433b-4014-bcdc-ee8195544ea5" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:41:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b5811802-d5ae-478c-aa7a-b17d8d5f96de tempest-SnapshotsActionsTest-610139172 None] Lock "cinder-quobyte-d69f97e5-433b-4014-bcdc-ee8195544ea5" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:41:54 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-b5811802-d5ae-478c-aa7a-b17d8d5f96de tempest-SnapshotsActionsTest-610139172 None] Deleting offline snapshot d69f97e5-433b-4014-bcdc-ee8195544ea5 of volume 401dd639-a868-4632-9d5f-b2584ea7528f {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:41:54 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-b5811802-d5ae-478c-aa7a-b17d8d5f96de tempest-SnapshotsActionsTest-610139172 None] snapshot_file for this snap is: volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:41:54 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fa5803-3437-40d2-a8c4-b7ca73ef42fd]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:41:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b5811802-d5ae-478c-aa7a-b17d8d5f96de tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:54 devstack sudo[88772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 Apr 02 12:41:54 devstack sudo[88772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:54 devstack sudo[88772]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b5811802-d5ae-478c-aa7a-b17d8d5f96de tempest-SnapshotsActionsTest-610139172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5" returned: 0 in 0.465s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:54 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-b5811802-d5ae-478c-aa7a-b17d8d5f96de tempest-SnapshotsActionsTest-610139172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-401dd639-a868-4632-9d5f-b2584ea7528f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:41:54 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[91750a5d-e7be-4497-93a1-559d47155a6a]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:41:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b5811802-d5ae-478c-aa7a-b17d8d5f96de tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:54 devstack sudo[88777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f Apr 02 12:41:54 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:55 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b5811802-d5ae-478c-aa7a-b17d8d5f96de tempest-SnapshotsActionsTest-610139172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f" returned: 0 in 0.456s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b5811802-d5ae-478c-aa7a-b17d8d5f96de tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:55 devstack sudo[88782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 Apr 02 12:41:55 devstack sudo[88782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:55 devstack sudo[88782]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b5811802-d5ae-478c-aa7a-b17d8d5f96de tempest-SnapshotsActionsTest-610139172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5" returned: 0 in 0.478s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b5811802-d5ae-478c-aa7a-b17d8d5f96de tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:55 devstack sudo[88799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5 Apr 02 12:41:55 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:56 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b5811802-d5ae-478c-aa7a-b17d8d5f96de tempest-SnapshotsActionsTest-610139172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f.d69f97e5-433b-4014-bcdc-ee8195544ea5" returned: 0 in 0.426s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:56 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:UPDATE=124,cinder:SELECT=135,cinder:INSERT=29,cinder:DELETE=7 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:41:56 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:INSERT=32,cinder:UPDATE=117,cinder:DELETE=5,cinder:SELECT=102 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:41:56 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b5811802-d5ae-478c-aa7a-b17d8d5f96de tempest-SnapshotsActionsTest-610139172 None] Lock "cinder-quobyte-d69f97e5-433b-4014-bcdc-ee8195544ea5" released by "_delete_snapshot" :: held 1.895s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:41:56 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b5811802-d5ae-478c-aa7a-b17d8d5f96de tempest-SnapshotsActionsTest-610139172 None] Lock "cinder-quobyte-401dd639-a868-4632-9d5f-b2584ea7528f" released by "delete_snapshot" :: held 1.911s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:41:56 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-b5811802-d5ae-478c-aa7a-b17d8d5f96de tempest-SnapshotsActionsTest-610139172 None] Created reservations ['a7735e96-dc34-47ad-a8e0-9cb0557b2bcd', '9c394b2f-1619-484d-954c-20428d7bb299', '2ad70eeb-227a-4cf5-bfe2-d5a2a6184f20', 'b7ba8beb-7572-4dd8-9447-1f5bf03dc637'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:41:56 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-b5811802-d5ae-478c-aa7a-b17d8d5f96de tempest-SnapshotsActionsTest-610139172 None] Delete snapshot completed successfully. Apr 02 12:41:56 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b5811802-d5ae-478c-aa7a-b17d8d5f96de tempest-SnapshotsActionsTest-610139172 None] Lock "cinder-d69f97e5-433b-4014-bcdc-ee8195544ea5-delete_snapshot" released by "delete_snapshot" :: held 2.014s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:41:56 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-9d32bc63-dac2-42e9-a3ea-758bdd171226 tempest-SnapshotsActionsTest-610139172 None] Acquiring lock "cinder-401dd639-a868-4632-9d5f-b2584ea7528f-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:41:56 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-9d32bc63-dac2-42e9-a3ea-758bdd171226 tempest-SnapshotsActionsTest-610139172 None] Lock "cinder-401dd639-a868-4632-9d5f-b2584ea7528f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:41:56 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-9d32bc63-dac2-42e9-a3ea-758bdd171226 tempest-SnapshotsActionsTest-610139172 None] Acquiring lock "cinder-quobyte-401dd639-a868-4632-9d5f-b2584ea7528f" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:41:56 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-9d32bc63-dac2-42e9-a3ea-758bdd171226 tempest-SnapshotsActionsTest-610139172 None] Lock "cinder-quobyte-401dd639-a868-4632-9d5f-b2584ea7528f" acquired by "delete_volume" :: waited 0.013s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:41:56 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bb798e-68d4-4bba-9eb7-825b55a15375]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:41:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9d32bc63-dac2-42e9-a3ea-758bdd171226 tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:56 devstack sudo[88824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f Apr 02 12:41:56 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:57 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9d32bc63-dac2-42e9-a3ea-758bdd171226 tempest-SnapshotsActionsTest-610139172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f" returned: 0 in 0.546s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9d32bc63-dac2-42e9-a3ea-758bdd171226 tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:57 devstack sudo[88829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f Apr 02 12:41:57 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:57 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9d32bc63-dac2-42e9-a3ea-758bdd171226 tempest-SnapshotsActionsTest-610139172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-401dd639-a868-4632-9d5f-b2584ea7528f" returned: 0 in 0.498s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:57 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-9d32bc63-dac2-42e9-a3ea-758bdd171226 tempest-SnapshotsActionsTest-610139172 None] Lock "cinder-quobyte-401dd639-a868-4632-9d5f-b2584ea7528f" released by "delete_volume" :: held 1.080s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:41:57 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-9d32bc63-dac2-42e9-a3ea-758bdd171226 tempest-SnapshotsActionsTest-610139172 None] Created reservations ['cb66e882-2d3c-40c6-bb2a-c09bdefa76b7', '72619d87-2577-4702-8ba1-a37da3145045', '0116c969-2537-4914-9228-3d066f364921', '8dd07c05-3a5b-4c79-b3a8-e407b4264c8b'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:41:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9d32bc63-dac2-42e9-a3ea-758bdd171226 tempest-SnapshotsActionsTest-610139172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:41:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9d32bc63-dac2-42e9-a3ea-758bdd171226 tempest-SnapshotsActionsTest-610139172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:41:57 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9d32bc63-dac2-42e9-a3ea-758bdd171226 tempest-SnapshotsActionsTest-610139172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:41:57 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9d32bc63-dac2-42e9-a3ea-758bdd171226 tempest-SnapshotsActionsTest-610139172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:41:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9d32bc63-dac2-42e9-a3ea-758bdd171226 tempest-SnapshotsActionsTest-610139172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:41:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9d32bc63-dac2-42e9-a3ea-758bdd171226 tempest-SnapshotsActionsTest-610139172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:41:57 devstack sudo[88833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:41:57 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:41:58 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root Apr 02 12:41:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9d32bc63-dac2-42e9-a3ea-758bdd171226 tempest-SnapshotsActionsTest-610139172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.426s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:41:58 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-9d32bc63-dac2-42e9-a3ea-758bdd171226 tempest-SnapshotsActionsTest-610139172 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:41:58 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-9d32bc63-dac2-42e9-a3ea-758bdd171226 tempest-SnapshotsActionsTest-610139172 None] Deleted volume successfully. Apr 02 12:41:58 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-9d32bc63-dac2-42e9-a3ea-758bdd171226 tempest-SnapshotsActionsTest-610139172 None] Lock "cinder-401dd639-a868-4632-9d5f-b2584ea7528f-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:42:06 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:42:06 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Flow 'volume_create_manager' (8f1cba5a-4dca-430d-8db0-0e47d21f840e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:42:06 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (327e6a25-b49f-4b7b-a414-2a4fdbac43f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:06 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (327e6a25-b49f-4b7b-a414-2a4fdbac43f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-914096199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392af316-dc76-462c-a19f-043a125df5ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fefb5aa781e943cf9a0ab79345e0e7f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:42:07Z,use_quota=True,user_id='96b19295c2c04b8bab1415fed4d62536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:06 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc437ab6-c3a8-4c52-bf92-76bca9761a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:06 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc437ab6-c3a8-4c52-bf92-76bca9761a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:06 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12486cb2-f3fc-41b7-9df1-b8f322a5cb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:06 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12486cb2-f3fc-41b7-9df1-b8f322a5cb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '392af316-dc76-462c-a19f-043a125df5ce', 'volume_name': 'volume-392af316-dc76-462c-a19f-043a125df5ce', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:06 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca08657-5f57-446a-9b24-7bbbab08de3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:06 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca08657-5f57-446a-9b24-7bbbab08de3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:06 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab349fc9-077e-47f7-b941-e5bc88271dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:06 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Volume 392af316-dc76-462c-a19f-043a125df5ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-392af316-dc76-462c-a19f-043a125df5ce', 'volume_size': 1} Apr 02 12:42:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:42:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:42:06 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-914096199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392af316-dc76-462c-a19f-043a125df5ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fefb5aa781e943cf9a0ab79345e0e7f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:42:07Z,use_quota=True,user_id='96b19295c2c04b8bab1415fed4d62536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:42:06 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Creating volume 392af316-dc76-462c-a19f-043a125df5ce {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:42:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:42:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:42:06 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:42:06 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:42:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:42:06 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:42:06 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:42:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-392af316-dc76-462c-a19f-043a125df5ce 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:06 devstack sudo[88838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-392af316-dc76-462c-a19f-043a125df5ce 1073741824 Apr 02 12:42:06 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:07 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-392af316-dc76-462c-a19f-043a125df5ce 1073741824" returned: 0 in 0.578s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-392af316-dc76-462c-a19f-043a125df5ce {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:07 devstack sudo[88843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-392af316-dc76-462c-a19f-043a125df5ce Apr 02 12:42:07 devstack sudo[88843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:07 devstack sudo[88843]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-392af316-dc76-462c-a19f-043a125df5ce" returned: 0 in 0.456s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:07 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:42:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:42:07 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab349fc9-077e-47f7-b941-e5bc88271dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-392af316-dc76-462c-a19f-043a125df5ce', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:07 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d053bb60-3d86-4dee-9c28-defa9dfcc422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:07 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Volume volume-392af316-dc76-462c-a19f-043a125df5ce (392af316-dc76-462c-a19f-043a125df5ce): created successfully Apr 02 12:42:07 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d053bb60-3d86-4dee-9c28-defa9dfcc422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:07 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Flow 'volume_create_manager' (8f1cba5a-4dca-430d-8db0-0e47d21f840e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:42:07 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-7dfb1c1a-ebbc-4482-9805-2c40abf798c2 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Created volume successfully. Apr 02 12:42:08 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a868eef4-d3a7-4ed4-b01f-e5541642863d tempest-VolumeQuotasAdminTestJSON-1287357271 None] Acquiring lock "cinder-392af316-dc76-462c-a19f-043a125df5ce-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:42:08 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a868eef4-d3a7-4ed4-b01f-e5541642863d tempest-VolumeQuotasAdminTestJSON-1287357271 None] Lock "cinder-392af316-dc76-462c-a19f-043a125df5ce-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:42:08 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a868eef4-d3a7-4ed4-b01f-e5541642863d tempest-VolumeQuotasAdminTestJSON-1287357271 None] Acquiring lock "cinder-quobyte-392af316-dc76-462c-a19f-043a125df5ce" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:42:08 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a868eef4-d3a7-4ed4-b01f-e5541642863d tempest-VolumeQuotasAdminTestJSON-1287357271 None] Lock "cinder-quobyte-392af316-dc76-462c-a19f-043a125df5ce" acquired by "delete_volume" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:42:08 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c02400-a29b-41fc-b3cc-439295180481]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:42:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a868eef4-d3a7-4ed4-b01f-e5541642863d tempest-VolumeQuotasAdminTestJSON-1287357271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-392af316-dc76-462c-a19f-043a125df5ce {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:08 devstack sudo[88849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-392af316-dc76-462c-a19f-043a125df5ce Apr 02 12:42:08 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:09 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a868eef4-d3a7-4ed4-b01f-e5541642863d tempest-VolumeQuotasAdminTestJSON-1287357271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-392af316-dc76-462c-a19f-043a125df5ce" returned: 0 in 0.481s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a868eef4-d3a7-4ed4-b01f-e5541642863d tempest-VolumeQuotasAdminTestJSON-1287357271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-392af316-dc76-462c-a19f-043a125df5ce {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:09 devstack sudo[88854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-392af316-dc76-462c-a19f-043a125df5ce Apr 02 12:42:09 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:09 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a868eef4-d3a7-4ed4-b01f-e5541642863d tempest-VolumeQuotasAdminTestJSON-1287357271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-392af316-dc76-462c-a19f-043a125df5ce" returned: 0 in 0.420s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:09 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a868eef4-d3a7-4ed4-b01f-e5541642863d tempest-VolumeQuotasAdminTestJSON-1287357271 None] Lock "cinder-quobyte-392af316-dc76-462c-a19f-043a125df5ce" released by "delete_volume" :: held 0.929s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:42:09 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-a868eef4-d3a7-4ed4-b01f-e5541642863d tempest-VolumeQuotasAdminTestJSON-1287357271 None] Created reservations ['77e5b52c-2710-454c-9bb7-b8fb7456d078', '7c383a23-bbd1-4e61-ab3d-e8cb91589b16', '594265e1-1b80-4267-9349-b28a23573f6f', 'c5f4768d-37c3-4c73-bb37-3d398fe2c3f5'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:42:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a868eef4-d3a7-4ed4-b01f-e5541642863d tempest-VolumeQuotasAdminTestJSON-1287357271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:42:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a868eef4-d3a7-4ed4-b01f-e5541642863d tempest-VolumeQuotasAdminTestJSON-1287357271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:42:09 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a868eef4-d3a7-4ed4-b01f-e5541642863d tempest-VolumeQuotasAdminTestJSON-1287357271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:42:09 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a868eef4-d3a7-4ed4-b01f-e5541642863d tempest-VolumeQuotasAdminTestJSON-1287357271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:42:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a868eef4-d3a7-4ed4-b01f-e5541642863d tempest-VolumeQuotasAdminTestJSON-1287357271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:42:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a868eef4-d3a7-4ed4-b01f-e5541642863d tempest-VolumeQuotasAdminTestJSON-1287357271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:09 devstack sudo[88857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:42:09 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:10 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:42:10 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Flow 'volume_create_manager' (b6ba8f40-e679-4008-8fcb-51ed20926a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:42:10 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483eb2fe-1a51-4fea-b700-a1f1d100f5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:10 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483eb2fe-1a51-4fea-b700-a1f1d100f5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1657667700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3757c8de-78b4-4b43-a7e4-3958b4cc39a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fefb5aa781e943cf9a0ab79345e0e7f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:42:10Z,use_quota=True,user_id='96b19295c2c04b8bab1415fed4d62536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:10 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (406d45fc-1e32-413a-aa76-878ffcabe849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:10 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (406d45fc-1e32-413a-aa76-878ffcabe849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:10 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8b30d4-2145-459c-ba5b-5b5f363d8350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:10 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8b30d4-2145-459c-ba5b-5b5f363d8350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3757c8de-78b4-4b43-a7e4-3958b4cc39a1', 'volume_name': 'volume-3757c8de-78b4-4b43-a7e4-3958b4cc39a1', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:10 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c23f4b5-1a1f-44d7-8c63-ec8ed806753b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:10 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c23f4b5-1a1f-44d7-8c63-ec8ed806753b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:10 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb2cc25a-7d9c-497f-8b8c-2a30689e794b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:10 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Volume 3757c8de-78b4-4b43-a7e4-3958b4cc39a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3757c8de-78b4-4b43-a7e4-3958b4cc39a1', 'volume_size': 1} Apr 02 12:42:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:42:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:42:10 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1657667700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3757c8de-78b4-4b43-a7e4-3958b4cc39a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fefb5aa781e943cf9a0ab79345e0e7f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:42:10Z,use_quota=True,user_id='96b19295c2c04b8bab1415fed4d62536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:42:10 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Creating volume 3757c8de-78b4-4b43-a7e4-3958b4cc39a1 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:42:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:42:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:42:10 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:42:10 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:42:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:42:10 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:42:10 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:42:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3757c8de-78b4-4b43-a7e4-3958b4cc39a1 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:10 devstack sudo[88860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3757c8de-78b4-4b43-a7e4-3958b4cc39a1 1073741824 Apr 02 12:42:10 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:10 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a868eef4-d3a7-4ed4-b01f-e5541642863d tempest-VolumeQuotasAdminTestJSON-1287357271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.507s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:10 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-a868eef4-d3a7-4ed4-b01f-e5541642863d tempest-VolumeQuotasAdminTestJSON-1287357271 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:42:10 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-a868eef4-d3a7-4ed4-b01f-e5541642863d tempest-VolumeQuotasAdminTestJSON-1287357271 None] Deleted volume successfully. Apr 02 12:42:10 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a868eef4-d3a7-4ed4-b01f-e5541642863d tempest-VolumeQuotasAdminTestJSON-1287357271 None] Lock "cinder-392af316-dc76-462c-a19f-043a125df5ce-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:42:10 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3757c8de-78b4-4b43-a7e4-3958b4cc39a1 1073741824" returned: 0 in 0.485s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3757c8de-78b4-4b43-a7e4-3958b4cc39a1 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:10 devstack sudo[88865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3757c8de-78b4-4b43-a7e4-3958b4cc39a1 Apr 02 12:42:10 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:11 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3757c8de-78b4-4b43-a7e4-3958b4cc39a1" returned: 0 in 0.389s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:11 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:42:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:42:11 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb2cc25a-7d9c-497f-8b8c-2a30689e794b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3757c8de-78b4-4b43-a7e4-3958b4cc39a1', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:11 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ba06412-23cd-48db-80e6-9a04ae50254e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:11 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Volume volume-3757c8de-78b4-4b43-a7e4-3958b4cc39a1 (3757c8de-78b4-4b43-a7e4-3958b4cc39a1): created successfully Apr 02 12:42:11 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ba06412-23cd-48db-80e6-9a04ae50254e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:11 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Flow 'volume_create_manager' (b6ba8f40-e679-4008-8fcb-51ed20926a5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:42:11 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-d38f5d8c-21d8-4efa-a01d-2be840069266 tempest-VolumeQuotasAdminTestJSON-1287357271 None] Created volume successfully. Apr 02 12:42:12 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-0daa1143-f2cc-4270-a515-d4daa1945289 tempest-VolumeQuotasAdminTestJSON-325910926 None] Transfer volume completed successfully. Apr 02 12:42:13 devstack cinder-volume[82819]: DEBUG oslo_service.periodic_task [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82819) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 12:42:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:42:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:42:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:42:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:42:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:42:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:13 devstack sudo[88868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:42:13 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:13 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.441s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:13 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:42:13 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-5f36865d-869b-44f5-8857-84fdccbaeda3 tempest-VolumeQuotasAdminTestJSON-408811778 None] Acquiring lock "cinder-3757c8de-78b4-4b43-a7e4-3958b4cc39a1-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:42:13 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-5f36865d-869b-44f5-8857-84fdccbaeda3 tempest-VolumeQuotasAdminTestJSON-408811778 None] Lock "cinder-3757c8de-78b4-4b43-a7e4-3958b4cc39a1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:42:13 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-5f36865d-869b-44f5-8857-84fdccbaeda3 tempest-VolumeQuotasAdminTestJSON-408811778 None] Acquiring lock "cinder-quobyte-3757c8de-78b4-4b43-a7e4-3958b4cc39a1" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:42:13 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-5f36865d-869b-44f5-8857-84fdccbaeda3 tempest-VolumeQuotasAdminTestJSON-408811778 None] Lock "cinder-quobyte-3757c8de-78b4-4b43-a7e4-3958b4cc39a1" acquired by "delete_volume" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:42:13 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[57996bcb-0c66-4972-836d-d2deb28bdcd0]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:42:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5f36865d-869b-44f5-8857-84fdccbaeda3 tempest-VolumeQuotasAdminTestJSON-408811778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3757c8de-78b4-4b43-a7e4-3958b4cc39a1 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:13 devstack sudo[88871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3757c8de-78b4-4b43-a7e4-3958b4cc39a1 Apr 02 12:42:13 devstack sudo[88871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:14 devstack sudo[88871]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5f36865d-869b-44f5-8857-84fdccbaeda3 tempest-VolumeQuotasAdminTestJSON-408811778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3757c8de-78b4-4b43-a7e4-3958b4cc39a1" returned: 0 in 0.491s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5f36865d-869b-44f5-8857-84fdccbaeda3 tempest-VolumeQuotasAdminTestJSON-408811778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3757c8de-78b4-4b43-a7e4-3958b4cc39a1 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:14 devstack sudo[88876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3757c8de-78b4-4b43-a7e4-3958b4cc39a1 Apr 02 12:42:14 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:14 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5f36865d-869b-44f5-8857-84fdccbaeda3 tempest-VolumeQuotasAdminTestJSON-408811778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3757c8de-78b4-4b43-a7e4-3958b4cc39a1" returned: 0 in 0.420s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:14 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-5f36865d-869b-44f5-8857-84fdccbaeda3 tempest-VolumeQuotasAdminTestJSON-408811778 None] Lock "cinder-quobyte-3757c8de-78b4-4b43-a7e4-3958b4cc39a1" released by "delete_volume" :: held 0.940s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:42:14 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-5f36865d-869b-44f5-8857-84fdccbaeda3 tempest-VolumeQuotasAdminTestJSON-408811778 None] Created reservations ['5dc083fe-a170-40d7-acce-83cbfe480f54', 'e929599e-c9d2-46e0-b57b-786d2eb0ae0b', '10a69561-2bae-44f0-8bd9-b2ed19059253', '51a42b9d-244d-4117-ba6b-61e64cd251ed'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:42:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-5f36865d-869b-44f5-8857-84fdccbaeda3 tempest-VolumeQuotasAdminTestJSON-408811778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:42:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-5f36865d-869b-44f5-8857-84fdccbaeda3 tempest-VolumeQuotasAdminTestJSON-408811778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:42:14 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-5f36865d-869b-44f5-8857-84fdccbaeda3 tempest-VolumeQuotasAdminTestJSON-408811778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:42:14 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-5f36865d-869b-44f5-8857-84fdccbaeda3 tempest-VolumeQuotasAdminTestJSON-408811778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:42:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-5f36865d-869b-44f5-8857-84fdccbaeda3 tempest-VolumeQuotasAdminTestJSON-408811778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:42:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5f36865d-869b-44f5-8857-84fdccbaeda3 tempest-VolumeQuotasAdminTestJSON-408811778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:14 devstack sudo[88879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:42:14 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:15 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5f36865d-869b-44f5-8857-84fdccbaeda3 tempest-VolumeQuotasAdminTestJSON-408811778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.500s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:15 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-5f36865d-869b-44f5-8857-84fdccbaeda3 tempest-VolumeQuotasAdminTestJSON-408811778 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:42:15 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-5f36865d-869b-44f5-8857-84fdccbaeda3 tempest-VolumeQuotasAdminTestJSON-408811778 None] Deleted volume successfully. Apr 02 12:42:15 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-5f36865d-869b-44f5-8857-84fdccbaeda3 tempest-VolumeQuotasAdminTestJSON-408811778 None] Lock "cinder-3757c8de-78b4-4b43-a7e4-3958b4cc39a1-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:42:19 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:42:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Flow 'volume_create_manager' (8af271ac-814d-4ec8-95b9-c04b6ea167ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:42:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70acdb6e-cdc2-471a-8a2b-61d6ef883fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70acdb6e-cdc2-471a-8a2b-61d6ef883fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-493925709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ca193b-4141-4de1-9189-9986a08b61d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c5f625556bc49b1aa3bbd0b45211665',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:42:20Z,use_quota=True,user_id='cf09b89c47dd40259a619731c55f790e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e820f0f-2612-4a36-9301-5db52809bb2c),volume_type_id=5e820f0f-2612-4a36-9301-5db52809bb2c)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6094f3a3-1b2d-40c7-9cba-03fd8f821cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6094f3a3-1b2d-40c7-9cba-03fd8f821cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49410388-64e9-415a-b9cd-2cf626591d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49410388-64e9-415a-b9cd-2cf626591d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17ca193b-4141-4de1-9189-9986a08b61d9', 'volume_name': 'volume-17ca193b-4141-4de1-9189-9986a08b61d9', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4489f2-6dc4-4c66-b217-4ab3aa83802a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4489f2-6dc4-4c66-b217-4ab3aa83802a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0233ce8d-0947-4f93-ab1e-88d51ed48146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:19 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Volume 17ca193b-4141-4de1-9189-9986a08b61d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17ca193b-4141-4de1-9189-9986a08b61d9', 'volume_size': 1} Apr 02 12:42:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:42:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:42:19 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-493925709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ca193b-4141-4de1-9189-9986a08b61d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c5f625556bc49b1aa3bbd0b45211665',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:42:20Z,use_quota=True,user_id='cf09b89c47dd40259a619731c55f790e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e820f0f-2612-4a36-9301-5db52809bb2c),volume_type_id=5e820f0f-2612-4a36-9301-5db52809bb2c)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:42:19 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Creating volume 17ca193b-4141-4de1-9189-9986a08b61d9 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:42:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:42:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:42:19 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:42:19 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:42:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:42:19 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:42:19 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:42:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-17ca193b-4141-4de1-9189-9986a08b61d9 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:19 devstack sudo[88883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-17ca193b-4141-4de1-9189-9986a08b61d9 1073741824 Apr 02 12:42:19 devstack sudo[88883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:20 devstack sudo[88883]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-17ca193b-4141-4de1-9189-9986a08b61d9 1073741824" returned: 0 in 0.452s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-17ca193b-4141-4de1-9189-9986a08b61d9 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:20 devstack sudo[88888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-17ca193b-4141-4de1-9189-9986a08b61d9 Apr 02 12:42:20 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:20 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-17ca193b-4141-4de1-9189-9986a08b61d9" returned: 0 in 0.381s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:20 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:42:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:42:20 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0233ce8d-0947-4f93-ab1e-88d51ed48146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17ca193b-4141-4de1-9189-9986a08b61d9', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:20 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d49998b4-9d5c-4bf5-93e1-106580979366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:20 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Volume volume-17ca193b-4141-4de1-9189-9986a08b61d9 (17ca193b-4141-4de1-9189-9986a08b61d9): created successfully Apr 02 12:42:20 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d49998b4-9d5c-4bf5-93e1-106580979366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:20 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Flow 'volume_create_manager' (8af271ac-814d-4ec8-95b9-c04b6ea167ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:42:20 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-7bf5a883-c412-4aab-805b-93c7d0516a48 tempest-VolumeTypesAccessTest-1603514763 None] Created volume successfully. Apr 02 12:42:20 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-bc7e2ca3-2bd9-4112-8eb6-1d072fb12e81 tempest-VolumeTypesAccessTest-1603514763 None] Acquiring lock "cinder-17ca193b-4141-4de1-9189-9986a08b61d9-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:42:20 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-bc7e2ca3-2bd9-4112-8eb6-1d072fb12e81 tempest-VolumeTypesAccessTest-1603514763 None] Lock "cinder-17ca193b-4141-4de1-9189-9986a08b61d9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:42:20 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-bc7e2ca3-2bd9-4112-8eb6-1d072fb12e81 tempest-VolumeTypesAccessTest-1603514763 None] Acquiring lock "cinder-quobyte-17ca193b-4141-4de1-9189-9986a08b61d9" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:42:20 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-bc7e2ca3-2bd9-4112-8eb6-1d072fb12e81 tempest-VolumeTypesAccessTest-1603514763 None] Lock "cinder-quobyte-17ca193b-4141-4de1-9189-9986a08b61d9" acquired by "delete_volume" :: waited 0.013s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:42:20 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bd954c-e0ff-4116-8b26-b0356737f71a]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:42:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bc7e2ca3-2bd9-4112-8eb6-1d072fb12e81 tempest-VolumeTypesAccessTest-1603514763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-17ca193b-4141-4de1-9189-9986a08b61d9 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:20 devstack sudo[88891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-17ca193b-4141-4de1-9189-9986a08b61d9 Apr 02 12:42:20 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:21 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bc7e2ca3-2bd9-4112-8eb6-1d072fb12e81 tempest-VolumeTypesAccessTest-1603514763 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-17ca193b-4141-4de1-9189-9986a08b61d9" returned: 0 in 0.466s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bc7e2ca3-2bd9-4112-8eb6-1d072fb12e81 tempest-VolumeTypesAccessTest-1603514763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-17ca193b-4141-4de1-9189-9986a08b61d9 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:21 devstack sudo[88896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-17ca193b-4141-4de1-9189-9986a08b61d9 Apr 02 12:42:21 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:21 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bc7e2ca3-2bd9-4112-8eb6-1d072fb12e81 tempest-VolumeTypesAccessTest-1603514763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-17ca193b-4141-4de1-9189-9986a08b61d9" returned: 0 in 0.406s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:21 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-bc7e2ca3-2bd9-4112-8eb6-1d072fb12e81 tempest-VolumeTypesAccessTest-1603514763 None] Lock "cinder-quobyte-17ca193b-4141-4de1-9189-9986a08b61d9" released by "delete_volume" :: held 0.905s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:42:21 devstack cinder-volume[82819]: WARNING cinder.quota [None req-bc7e2ca3-2bd9-4112-8eb6-1d072fb12e81 tempest-VolumeTypesAccessTest-1603514763 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-224974930 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-224974930, it is now deprecated. Please use the default quota class for default quota. Apr 02 12:42:21 devstack cinder-volume[82819]: WARNING cinder.quota [None req-bc7e2ca3-2bd9-4112-8eb6-1d072fb12e81 tempest-VolumeTypesAccessTest-1603514763 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-224974930 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-224974930, it is now deprecated. Please use the default quota class for default quota. Apr 02 12:42:21 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-bc7e2ca3-2bd9-4112-8eb6-1d072fb12e81 tempest-VolumeTypesAccessTest-1603514763 None] Created reservations ['0ecf4ba6-bfe1-44d4-b39e-e8a11871b43d', 'c65b118a-c9fc-42c4-9e16-37382f5b00ed', 'fb685e9c-6a56-4bf4-855c-090d8dbf8e88', '7698cc62-fa79-4205-88f6-7a9d1743c7b7'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:42:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-bc7e2ca3-2bd9-4112-8eb6-1d072fb12e81 tempest-VolumeTypesAccessTest-1603514763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:42:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-bc7e2ca3-2bd9-4112-8eb6-1d072fb12e81 tempest-VolumeTypesAccessTest-1603514763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:42:21 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-bc7e2ca3-2bd9-4112-8eb6-1d072fb12e81 tempest-VolumeTypesAccessTest-1603514763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:42:21 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-bc7e2ca3-2bd9-4112-8eb6-1d072fb12e81 tempest-VolumeTypesAccessTest-1603514763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:42:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-bc7e2ca3-2bd9-4112-8eb6-1d072fb12e81 tempest-VolumeTypesAccessTest-1603514763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:42:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bc7e2ca3-2bd9-4112-8eb6-1d072fb12e81 tempest-VolumeTypesAccessTest-1603514763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:21 devstack sudo[88899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:42:21 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:22 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bc7e2ca3-2bd9-4112-8eb6-1d072fb12e81 tempest-VolumeTypesAccessTest-1603514763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.465s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:22 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-bc7e2ca3-2bd9-4112-8eb6-1d072fb12e81 tempest-VolumeTypesAccessTest-1603514763 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:42:22 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-bc7e2ca3-2bd9-4112-8eb6-1d072fb12e81 tempest-VolumeTypesAccessTest-1603514763 None] Deleted volume successfully. Apr 02 12:42:22 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-bc7e2ca3-2bd9-4112-8eb6-1d072fb12e81 tempest-VolumeTypesAccessTest-1603514763 None] Lock "cinder-17ca193b-4141-4de1-9189-9986a08b61d9-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:42:28 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:42:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Flow 'volume_create_manager' (4db5fed6-e1f2-48eb-ba6f-40468483e4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:42:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd0a2ac3-5a56-483a-8fbd-c1635c57144f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd0a2ac3-5a56-483a-8fbd-c1635c57144f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1601603439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036030f3-7488-46ee-98d3-9b0e111e4f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5645940401bc4b4eaca3d3d85f5b77ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:42:28Z,use_quota=True,user_id='0b623e569f174374a6f8193fc71de762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1208062-2bcf-4ec1-af0a-36951973f18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1208062-2bcf-4ec1-af0a-36951973f18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66f21e3a-1ae5-458e-aa49-ef69f5ffa22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66f21e3a-1ae5-458e-aa49-ef69f5ffa22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '036030f3-7488-46ee-98d3-9b0e111e4f0d', 'volume_name': 'volume-036030f3-7488-46ee-98d3-9b0e111e4f0d', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18eff04-a93f-460a-9943-d04985d6fd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18eff04-a93f-460a-9943-d04985d6fd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:28 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c46b22-0315-4225-b194-74856af17d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:28 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Volume 036030f3-7488-46ee-98d3-9b0e111e4f0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-036030f3-7488-46ee-98d3-9b0e111e4f0d', 'volume_size': 1} Apr 02 12:42:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:42:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:42:28 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1601603439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036030f3-7488-46ee-98d3-9b0e111e4f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5645940401bc4b4eaca3d3d85f5b77ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:42:28Z,use_quota=True,user_id='0b623e569f174374a6f8193fc71de762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:42:28 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Creating volume 036030f3-7488-46ee-98d3-9b0e111e4f0d {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:42:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:42:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:42:28 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:42:28 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:42:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:42:28 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:42:28 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:42:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:28 devstack sudo[88903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d 1073741824 Apr 02 12:42:28 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:28 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d 1073741824" returned: 0 in 0.459s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:28 devstack sudo[88908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d Apr 02 12:42:28 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:29 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d" returned: 0 in 0.379s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:29 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:42:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:42:29 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c46b22-0315-4225-b194-74856af17d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-036030f3-7488-46ee-98d3-9b0e111e4f0d', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:29 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f815dcfa-16d8-4ebf-8bf3-557d8cc70eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:29 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Volume volume-036030f3-7488-46ee-98d3-9b0e111e4f0d (036030f3-7488-46ee-98d3-9b0e111e4f0d): created successfully Apr 02 12:42:29 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f815dcfa-16d8-4ebf-8bf3-557d8cc70eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:29 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Flow 'volume_create_manager' (4db5fed6-e1f2-48eb-ba6f-40468483e4f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:42:29 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-800764a6-92a9-4cad-9cee-d712e72c8211 tempest-SnapshotMetadataTestJSON-183263531 None] Created volume successfully. Apr 02 12:42:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-50b44a94-4bf1-4ab7-8c1d-434b1066bdd7 tempest-SnapshotMetadataTestJSON-183263531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:42:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-50b44a94-4bf1-4ab7-8c1d-434b1066bdd7 tempest-SnapshotMetadataTestJSON-183263531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:42:29 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-50b44a94-4bf1-4ab7-8c1d-434b1066bdd7 tempest-SnapshotMetadataTestJSON-183263531 None] Creating offline snapshot d5b93862-86fc-449e-a40c-90876e815d9c of volume 036030f3-7488-46ee-98d3-9b0e111e4f0d {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:42:29 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc3310b-22de-422f-adbf-dfce339b6aed]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:42:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-50b44a94-4bf1-4ab7-8c1d-434b1066bdd7 tempest-SnapshotMetadataTestJSON-183263531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:29 devstack sudo[88911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d Apr 02 12:42:29 devstack sudo[88911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:29 devstack sudo[88911]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-50b44a94-4bf1-4ab7-8c1d-434b1066bdd7 tempest-SnapshotMetadataTestJSON-183263531 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d" returned: 0 in 0.454s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-50b44a94-4bf1-4ab7-8c1d-434b1066bdd7 tempest-SnapshotMetadataTestJSON-183263531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d.d5b93862-86fc-449e-a40c-90876e815d9c 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:29 devstack sudo[88916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d.d5b93862-86fc-449e-a40c-90876e815d9c 1G Apr 02 12:42:29 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:30 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-50b44a94-4bf1-4ab7-8c1d-434b1066bdd7 tempest-SnapshotMetadataTestJSON-183263531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d.d5b93862-86fc-449e-a40c-90876e815d9c 1G" returned: 0 in 0.444s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-50b44a94-4bf1-4ab7-8c1d-434b1066bdd7 tempest-SnapshotMetadataTestJSON-183263531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-036030f3-7488-46ee-98d3-9b0e111e4f0d -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d.d5b93862-86fc-449e-a40c-90876e815d9c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:30 devstack sudo[88921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-036030f3-7488-46ee-98d3-9b0e111e4f0d -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d.d5b93862-86fc-449e-a40c-90876e815d9c Apr 02 12:42:30 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:30 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-50b44a94-4bf1-4ab7-8c1d-434b1066bdd7 tempest-SnapshotMetadataTestJSON-183263531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-036030f3-7488-46ee-98d3-9b0e111e4f0d -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d.d5b93862-86fc-449e-a40c-90876e815d9c" returned: 0 in 0.440s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:30 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-50b44a94-4bf1-4ab7-8c1d-434b1066bdd7 tempest-SnapshotMetadataTestJSON-183263531 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d.d5b93862-86fc-449e-a40c-90876e815d9c is being set with open permissions: ugo+rw Apr 02 12:42:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-50b44a94-4bf1-4ab7-8c1d-434b1066bdd7 tempest-SnapshotMetadataTestJSON-183263531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d.d5b93862-86fc-449e-a40c-90876e815d9c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:30 devstack sudo[88926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d.d5b93862-86fc-449e-a40c-90876e815d9c Apr 02 12:42:30 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:31 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-50b44a94-4bf1-4ab7-8c1d-434b1066bdd7 tempest-SnapshotMetadataTestJSON-183263531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d.d5b93862-86fc-449e-a40c-90876e815d9c" returned: 0 in 0.405s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-50b44a94-4bf1-4ab7-8c1d-434b1066bdd7 tempest-SnapshotMetadataTestJSON-183263531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:31 devstack sudo[88929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d.info Apr 02 12:42:31 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:31 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-50b44a94-4bf1-4ab7-8c1d-434b1066bdd7 tempest-SnapshotMetadataTestJSON-183263531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d.info" returned: 0 in 0.408s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:31 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-50b44a94-4bf1-4ab7-8c1d-434b1066bdd7 tempest-SnapshotMetadataTestJSON-183263531 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d.info is being set with open permissions: ugo+rw Apr 02 12:42:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-50b44a94-4bf1-4ab7-8c1d-434b1066bdd7 tempest-SnapshotMetadataTestJSON-183263531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:31 devstack sudo[88932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d.info Apr 02 12:42:31 devstack sudo[88932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:31 devstack sudo[88932]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-50b44a94-4bf1-4ab7-8c1d-434b1066bdd7 tempest-SnapshotMetadataTestJSON-183263531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d.info" returned: 0 in 0.374s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-50b44a94-4bf1-4ab7-8c1d-434b1066bdd7 tempest-SnapshotMetadataTestJSON-183263531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.588s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:42:31 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-50b44a94-4bf1-4ab7-8c1d-434b1066bdd7 tempest-SnapshotMetadataTestJSON-183263531 None] Create snapshot completed successfully Apr 02 12:42:32 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-93bd33c0-1832-4d21-9bbb-604cbbb018f8 tempest-SnapshotMetadataTestJSON-183263531 None] Acquiring lock "cinder-d5b93862-86fc-449e-a40c-90876e815d9c-delete_snapshot" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:42:32 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-93bd33c0-1832-4d21-9bbb-604cbbb018f8 tempest-SnapshotMetadataTestJSON-183263531 None] Lock "cinder-d5b93862-86fc-449e-a40c-90876e815d9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:42:32 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-93bd33c0-1832-4d21-9bbb-604cbbb018f8 tempest-SnapshotMetadataTestJSON-183263531 None] Acquiring lock "cinder-quobyte-036030f3-7488-46ee-98d3-9b0e111e4f0d" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:42:32 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-93bd33c0-1832-4d21-9bbb-604cbbb018f8 tempest-SnapshotMetadataTestJSON-183263531 None] Lock "cinder-quobyte-036030f3-7488-46ee-98d3-9b0e111e4f0d" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:42:32 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-93bd33c0-1832-4d21-9bbb-604cbbb018f8 tempest-SnapshotMetadataTestJSON-183263531 None] Acquiring lock "cinder-quobyte-d5b93862-86fc-449e-a40c-90876e815d9c" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:42:33 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-93bd33c0-1832-4d21-9bbb-604cbbb018f8 tempest-SnapshotMetadataTestJSON-183263531 None] Lock "cinder-quobyte-d5b93862-86fc-449e-a40c-90876e815d9c" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:42:33 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-93bd33c0-1832-4d21-9bbb-604cbbb018f8 tempest-SnapshotMetadataTestJSON-183263531 None] Deleting offline snapshot d5b93862-86fc-449e-a40c-90876e815d9c of volume 036030f3-7488-46ee-98d3-9b0e111e4f0d {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:42:33 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-93bd33c0-1832-4d21-9bbb-604cbbb018f8 tempest-SnapshotMetadataTestJSON-183263531 None] snapshot_file for this snap is: volume-036030f3-7488-46ee-98d3-9b0e111e4f0d.d5b93862-86fc-449e-a40c-90876e815d9c {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:42:33 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1903ca1-d915-42f6-b73d-86630c2704a9]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:42:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-93bd33c0-1832-4d21-9bbb-604cbbb018f8 tempest-SnapshotMetadataTestJSON-183263531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d.d5b93862-86fc-449e-a40c-90876e815d9c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:33 devstack sudo[88935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d.d5b93862-86fc-449e-a40c-90876e815d9c Apr 02 12:42:33 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:33 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-93bd33c0-1832-4d21-9bbb-604cbbb018f8 tempest-SnapshotMetadataTestJSON-183263531 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d.d5b93862-86fc-449e-a40c-90876e815d9c" returned: 0 in 0.443s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:33 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-93bd33c0-1832-4d21-9bbb-604cbbb018f8 tempest-SnapshotMetadataTestJSON-183263531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-036030f3-7488-46ee-98d3-9b0e111e4f0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:42:33 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e70d4a-6612-4579-9177-145b6065e1da]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:42:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-93bd33c0-1832-4d21-9bbb-604cbbb018f8 tempest-SnapshotMetadataTestJSON-183263531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:33 devstack sudo[88940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d Apr 02 12:42:33 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:33 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-93bd33c0-1832-4d21-9bbb-604cbbb018f8 tempest-SnapshotMetadataTestJSON-183263531 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d" returned: 0 in 0.424s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-93bd33c0-1832-4d21-9bbb-604cbbb018f8 tempest-SnapshotMetadataTestJSON-183263531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d.d5b93862-86fc-449e-a40c-90876e815d9c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:33 devstack sudo[88945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d.d5b93862-86fc-449e-a40c-90876e815d9c Apr 02 12:42:33 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:34 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-93bd33c0-1832-4d21-9bbb-604cbbb018f8 tempest-SnapshotMetadataTestJSON-183263531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d.d5b93862-86fc-449e-a40c-90876e815d9c" returned: 0 in 0.415s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-93bd33c0-1832-4d21-9bbb-604cbbb018f8 tempest-SnapshotMetadataTestJSON-183263531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d.d5b93862-86fc-449e-a40c-90876e815d9c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:34 devstack sudo[88950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d.d5b93862-86fc-449e-a40c-90876e815d9c Apr 02 12:42:34 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:34 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-93bd33c0-1832-4d21-9bbb-604cbbb018f8 tempest-SnapshotMetadataTestJSON-183263531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d.d5b93862-86fc-449e-a40c-90876e815d9c" returned: 0 in 0.379s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-93bd33c0-1832-4d21-9bbb-604cbbb018f8 tempest-SnapshotMetadataTestJSON-183263531 None] Lock "cinder-quobyte-d5b93862-86fc-449e-a40c-90876e815d9c" released by "_delete_snapshot" :: held 1.734s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:42:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-93bd33c0-1832-4d21-9bbb-604cbbb018f8 tempest-SnapshotMetadataTestJSON-183263531 None] Lock "cinder-quobyte-036030f3-7488-46ee-98d3-9b0e111e4f0d" released by "delete_snapshot" :: held 1.748s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:42:34 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-93bd33c0-1832-4d21-9bbb-604cbbb018f8 tempest-SnapshotMetadataTestJSON-183263531 None] Created reservations ['48308d67-cdec-44d2-915e-1fbcab877be6', 'ae23faa7-d4f5-49ee-a130-6e3ed2877be5', '9c27c0a8-75a8-4c84-a9c2-cadc602bcf86', 'f84102fb-5e3d-4568-9884-9c7d7e4f4477'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:42:34 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-93bd33c0-1832-4d21-9bbb-604cbbb018f8 tempest-SnapshotMetadataTestJSON-183263531 None] Delete snapshot completed successfully. Apr 02 12:42:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-93bd33c0-1832-4d21-9bbb-604cbbb018f8 tempest-SnapshotMetadataTestJSON-183263531 None] Lock "cinder-d5b93862-86fc-449e-a40c-90876e815d9c-delete_snapshot" released by "delete_snapshot" :: held 1.836s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:42:35 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a140c836-13aa-4256-beed-ee50e65d3062 tempest-SnapshotMetadataTestJSON-183263531 None] Acquiring lock "cinder-036030f3-7488-46ee-98d3-9b0e111e4f0d-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:42:35 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a140c836-13aa-4256-beed-ee50e65d3062 tempest-SnapshotMetadataTestJSON-183263531 None] Lock "cinder-036030f3-7488-46ee-98d3-9b0e111e4f0d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:42:35 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a140c836-13aa-4256-beed-ee50e65d3062 tempest-SnapshotMetadataTestJSON-183263531 None] Acquiring lock "cinder-quobyte-036030f3-7488-46ee-98d3-9b0e111e4f0d" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:42:35 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a140c836-13aa-4256-beed-ee50e65d3062 tempest-SnapshotMetadataTestJSON-183263531 None] Lock "cinder-quobyte-036030f3-7488-46ee-98d3-9b0e111e4f0d" acquired by "delete_volume" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:42:35 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[310c9162-c7be-428d-8ee7-b3f00c04df9d]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:42:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a140c836-13aa-4256-beed-ee50e65d3062 tempest-SnapshotMetadataTestJSON-183263531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:35 devstack sudo[88953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d Apr 02 12:42:35 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:35 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a140c836-13aa-4256-beed-ee50e65d3062 tempest-SnapshotMetadataTestJSON-183263531 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d" returned: 0 in 0.460s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a140c836-13aa-4256-beed-ee50e65d3062 tempest-SnapshotMetadataTestJSON-183263531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:35 devstack sudo[88958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d Apr 02 12:42:35 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:36 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a140c836-13aa-4256-beed-ee50e65d3062 tempest-SnapshotMetadataTestJSON-183263531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-036030f3-7488-46ee-98d3-9b0e111e4f0d" returned: 0 in 0.387s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:36 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a140c836-13aa-4256-beed-ee50e65d3062 tempest-SnapshotMetadataTestJSON-183263531 None] Lock "cinder-quobyte-036030f3-7488-46ee-98d3-9b0e111e4f0d" released by "delete_volume" :: held 0.883s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:42:36 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-a140c836-13aa-4256-beed-ee50e65d3062 tempest-SnapshotMetadataTestJSON-183263531 None] Created reservations ['5bb7b9e2-ab85-4e9b-a36f-42014f1e0202', '18eee8e4-e331-4b31-9236-368701fddbe2', 'cff0ecf7-32d4-497d-8b6b-3ac0df3b6f9c', 'c7f8ccc0-093b-46eb-86a1-de0d248d81eb'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:42:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a140c836-13aa-4256-beed-ee50e65d3062 tempest-SnapshotMetadataTestJSON-183263531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:42:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a140c836-13aa-4256-beed-ee50e65d3062 tempest-SnapshotMetadataTestJSON-183263531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:42:36 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a140c836-13aa-4256-beed-ee50e65d3062 tempest-SnapshotMetadataTestJSON-183263531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:42:36 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a140c836-13aa-4256-beed-ee50e65d3062 tempest-SnapshotMetadataTestJSON-183263531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:42:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a140c836-13aa-4256-beed-ee50e65d3062 tempest-SnapshotMetadataTestJSON-183263531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:42:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a140c836-13aa-4256-beed-ee50e65d3062 tempest-SnapshotMetadataTestJSON-183263531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:36 devstack sudo[88961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:42:36 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:36 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a140c836-13aa-4256-beed-ee50e65d3062 tempest-SnapshotMetadataTestJSON-183263531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.431s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:36 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-a140c836-13aa-4256-beed-ee50e65d3062 tempest-SnapshotMetadataTestJSON-183263531 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:42:36 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-a140c836-13aa-4256-beed-ee50e65d3062 tempest-SnapshotMetadataTestJSON-183263531 None] Deleted volume successfully. Apr 02 12:42:36 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a140c836-13aa-4256-beed-ee50e65d3062 tempest-SnapshotMetadataTestJSON-183263531 None] Lock "cinder-036030f3-7488-46ee-98d3-9b0e111e4f0d-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:42:37 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:42:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Flow 'volume_create_manager' (43eabd51-3303-45d2-aa98-9ed9146fbe4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:42:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (276cce47-4310-4445-9050-acdf328bb03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (276cce47-4310-4445-9050-acdf328bb03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-511793298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33e94f2b-c13d-48b8-9680-938c8a13e3e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba92296e03c4965a968c954fc8e1f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:42:38Z,use_quota=True,user_id='778f4b01b7bd40c59364271a0c82b74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41675ed-b755-4560-975e-2583fe37366d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41675ed-b755-4560-975e-2583fe37366d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d8f722-a909-4db9-b367-505f90a2fa26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d8f722-a909-4db9-b367-505f90a2fa26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33e94f2b-c13d-48b8-9680-938c8a13e3e0', 'volume_name': 'volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf446be-1a13-4c95-8020-db1c932c2497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf446be-1a13-4c95-8020-db1c932c2497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f00ecd1-653c-4323-a81e-44c991878800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:37 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Volume 33e94f2b-c13d-48b8-9680-938c8a13e3e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0', 'volume_size': 1} Apr 02 12:42:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:42:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:42:37 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-511793298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33e94f2b-c13d-48b8-9680-938c8a13e3e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba92296e03c4965a968c954fc8e1f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:42:38Z,use_quota=True,user_id='778f4b01b7bd40c59364271a0c82b74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:42:37 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Creating volume 33e94f2b-c13d-48b8-9680-938c8a13e3e0 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:42:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:42:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:42:37 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:42:37 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:42:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:42:37 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:42:37 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:42:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:37 devstack sudo[88965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0 1073741824 Apr 02 12:42:37 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:38 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0 1073741824" returned: 0 in 0.454s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:38 devstack sudo[88970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0 Apr 02 12:42:38 devstack sudo[88970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:38 devstack sudo[88970]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0" returned: 0 in 0.389s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:42:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:42:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f00ecd1-653c-4323-a81e-44c991878800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d03bf9-c0c5-4cec-9410-cf54ebc8d1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:38 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Volume volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0 (33e94f2b-c13d-48b8-9680-938c8a13e3e0): created successfully Apr 02 12:42:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d03bf9-c0c5-4cec-9410-cf54ebc8d1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Flow 'volume_create_manager' (43eabd51-3303-45d2-aa98-9ed9146fbe4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:42:38 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-c6c5f4bf-559b-43a4-b111-8a034200441e tempest-VolumesDeleteCascade-1033226063 None] Created volume successfully. Apr 02 12:42:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-5627a49d-9639-4e1c-b2d6-c6126fa47ebb tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:42:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-5627a49d-9639-4e1c-b2d6-c6126fa47ebb tempest-VolumesDeleteCascade-1033226063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:42:39 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-5627a49d-9639-4e1c-b2d6-c6126fa47ebb tempest-VolumesDeleteCascade-1033226063 None] Creating offline snapshot 05225b3a-d74d-4886-a5f4-0e0099a3f144 of volume 33e94f2b-c13d-48b8-9680-938c8a13e3e0 {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:42:39 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40fc3cc-b463-43ca-b9a2-0b5ca2fca803]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:42:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5627a49d-9639-4e1c-b2d6-c6126fa47ebb tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:39 devstack sudo[88973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0 Apr 02 12:42:39 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:39 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5627a49d-9639-4e1c-b2d6-c6126fa47ebb tempest-VolumesDeleteCascade-1033226063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0" returned: 0 in 0.477s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5627a49d-9639-4e1c-b2d6-c6126fa47ebb tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:39 devstack sudo[88978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144 1G Apr 02 12:42:39 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:40 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5627a49d-9639-4e1c-b2d6-c6126fa47ebb tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144 1G" returned: 0 in 0.451s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5627a49d-9639-4e1c-b2d6-c6126fa47ebb tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:40 devstack sudo[88983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144 Apr 02 12:42:40 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:40 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5627a49d-9639-4e1c-b2d6-c6126fa47ebb tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144" returned: 0 in 0.398s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:40 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-5627a49d-9639-4e1c-b2d6-c6126fa47ebb tempest-VolumesDeleteCascade-1033226063 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144 is being set with open permissions: ugo+rw Apr 02 12:42:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5627a49d-9639-4e1c-b2d6-c6126fa47ebb tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:40 devstack sudo[88988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144 Apr 02 12:42:40 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:40 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5627a49d-9639-4e1c-b2d6-c6126fa47ebb tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144" returned: 0 in 0.406s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5627a49d-9639-4e1c-b2d6-c6126fa47ebb tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:40 devstack sudo[88991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.info Apr 02 12:42:40 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:41 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5627a49d-9639-4e1c-b2d6-c6126fa47ebb tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.info" returned: 0 in 0.398s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:41 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-5627a49d-9639-4e1c-b2d6-c6126fa47ebb tempest-VolumesDeleteCascade-1033226063 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.info is being set with open permissions: ugo+rw Apr 02 12:42:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5627a49d-9639-4e1c-b2d6-c6126fa47ebb tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:41 devstack sudo[88994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.info Apr 02 12:42:41 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:41 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5627a49d-9639-4e1c-b2d6-c6126fa47ebb tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.info" returned: 0 in 0.379s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-5627a49d-9639-4e1c-b2d6-c6126fa47ebb tempest-VolumesDeleteCascade-1033226063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.572s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:42:41 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-5627a49d-9639-4e1c-b2d6-c6126fa47ebb tempest-VolumesDeleteCascade-1033226063 None] Create snapshot completed successfully Apr 02 12:42:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c81da934-d10f-4e1f-b9b0-88f7722301cf tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:42:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c81da934-d10f-4e1f-b9b0-88f7722301cf tempest-VolumesDeleteCascade-1033226063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:42:42 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-c81da934-d10f-4e1f-b9b0-88f7722301cf tempest-VolumesDeleteCascade-1033226063 None] Creating offline snapshot 0494e790-ad2f-4c6c-94df-771bdb5f6bb4 of volume 33e94f2b-c13d-48b8-9680-938c8a13e3e0 {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:42:42 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[333882da-f450-42e5-a42c-d63d66aa633f]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:42:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c81da934-d10f-4e1f-b9b0-88f7722301cf tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:42 devstack sudo[89003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144 Apr 02 12:42:42 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:42 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c81da934-d10f-4e1f-b9b0-88f7722301cf tempest-VolumesDeleteCascade-1033226063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144" returned: 0 in 0.441s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:42 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-c81da934-d10f-4e1f-b9b0-88f7722301cf tempest-VolumesDeleteCascade-1033226063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:42:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c81da934-d10f-4e1f-b9b0-88f7722301cf tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.0494e790-ad2f-4c6c-94df-771bdb5f6bb4 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:42 devstack sudo[89008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.0494e790-ad2f-4c6c-94df-771bdb5f6bb4 1G Apr 02 12:42:42 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:43 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c81da934-d10f-4e1f-b9b0-88f7722301cf tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.0494e790-ad2f-4c6c-94df-771bdb5f6bb4 1G" returned: 0 in 0.447s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c81da934-d10f-4e1f-b9b0-88f7722301cf tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.0494e790-ad2f-4c6c-94df-771bdb5f6bb4 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:43 devstack sudo[89013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.0494e790-ad2f-4c6c-94df-771bdb5f6bb4 Apr 02 12:42:43 devstack sudo[89013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:43 devstack sudo[89013]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c81da934-d10f-4e1f-b9b0-88f7722301cf tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.0494e790-ad2f-4c6c-94df-771bdb5f6bb4" returned: 0 in 0.389s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:43 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-c81da934-d10f-4e1f-b9b0-88f7722301cf tempest-VolumesDeleteCascade-1033226063 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.0494e790-ad2f-4c6c-94df-771bdb5f6bb4 is being set with open permissions: ugo+rw Apr 02 12:42:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c81da934-d10f-4e1f-b9b0-88f7722301cf tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.0494e790-ad2f-4c6c-94df-771bdb5f6bb4 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:43 devstack sudo[89018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.0494e790-ad2f-4c6c-94df-771bdb5f6bb4 Apr 02 12:42:43 devstack sudo[89018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:44 devstack sudo[89018]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c81da934-d10f-4e1f-b9b0-88f7722301cf tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.0494e790-ad2f-4c6c-94df-771bdb5f6bb4" returned: 0 in 0.371s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c81da934-d10f-4e1f-b9b0-88f7722301cf tempest-VolumesDeleteCascade-1033226063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.702s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:42:44 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-c81da934-d10f-4e1f-b9b0-88f7722301cf tempest-VolumesDeleteCascade-1033226063 None] Create snapshot completed successfully Apr 02 12:42:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "cinder-33e94f2b-c13d-48b8-9680-938c8a13e3e0-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:42:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-33e94f2b-c13d-48b8-9680-938c8a13e3e0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:42:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Performing cascade delete. {{(pid=82819) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 02 12:42:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "cinder-0494e790-ad2f-4c6c-94df-771bdb5f6bb4-delete_snapshot" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:42:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-0494e790-ad2f-4c6c-94df-771bdb5f6bb4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:42:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "cinder-quobyte-33e94f2b-c13d-48b8-9680-938c8a13e3e0" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:42:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-quobyte-33e94f2b-c13d-48b8-9680-938c8a13e3e0" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:42:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "cinder-quobyte-0494e790-ad2f-4c6c-94df-771bdb5f6bb4" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:42:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-quobyte-0494e790-ad2f-4c6c-94df-771bdb5f6bb4" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:42:44 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Deleting offline snapshot 0494e790-ad2f-4c6c-94df-771bdb5f6bb4 of volume 33e94f2b-c13d-48b8-9680-938c8a13e3e0 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:42:44 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] snapshot_file for this snap is: volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.0494e790-ad2f-4c6c-94df-771bdb5f6bb4 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:42:44 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73b46cf-1276-4a41-bbf7-87c52671622a]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:42:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.0494e790-ad2f-4c6c-94df-771bdb5f6bb4 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:44 devstack sudo[89021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.0494e790-ad2f-4c6c-94df-771bdb5f6bb4 Apr 02 12:42:44 devstack sudo[89021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:44 devstack sudo[89021]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.0494e790-ad2f-4c6c-94df-771bdb5f6bb4" returned: 0 in 0.435s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:44 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:42:44 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[399ed155-43f0-4c25-a0dc-ddf95f231f26]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:42:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:45 devstack sudo[89026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144 Apr 02 12:42:45 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:45 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144" returned: 0 in 0.422s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:45 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:42:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.0494e790-ad2f-4c6c-94df-771bdb5f6bb4 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:45 devstack sudo[89031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.0494e790-ad2f-4c6c-94df-771bdb5f6bb4 Apr 02 12:42:45 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:45 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.0494e790-ad2f-4c6c-94df-771bdb5f6bb4" returned: 0 in 0.431s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.0494e790-ad2f-4c6c-94df-771bdb5f6bb4 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:45 devstack sudo[89036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.0494e790-ad2f-4c6c-94df-771bdb5f6bb4 Apr 02 12:42:45 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:46 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.0494e790-ad2f-4c6c-94df-771bdb5f6bb4" returned: 0 in 0.388s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:46 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-quobyte-0494e790-ad2f-4c6c-94df-771bdb5f6bb4" released by "_delete_snapshot" :: held 1.728s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:42:46 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-quobyte-33e94f2b-c13d-48b8-9680-938c8a13e3e0" released by "delete_snapshot" :: held 1.739s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:42:46 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Created reservations ['cf9d6b28-14f9-4367-b80e-0b7429ebd413', '6b41d94a-eced-4443-add2-59d92138a41f', 'e5cdd7a7-7b77-4abf-9259-9db0da669629', 'a42c402b-12c3-4a2e-bb1f-d980158e2e8e'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:42:46 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Delete snapshot completed successfully. Apr 02 12:42:46 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-0494e790-ad2f-4c6c-94df-771bdb5f6bb4-delete_snapshot" released by "delete_snapshot" :: held 1.858s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:42:46 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "cinder-05225b3a-d74d-4886-a5f4-0e0099a3f144-delete_snapshot" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:42:46 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-05225b3a-d74d-4886-a5f4-0e0099a3f144-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:42:46 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "cinder-quobyte-33e94f2b-c13d-48b8-9680-938c8a13e3e0" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:42:46 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-quobyte-33e94f2b-c13d-48b8-9680-938c8a13e3e0" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:42:46 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "cinder-quobyte-05225b3a-d74d-4886-a5f4-0e0099a3f144" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:42:46 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-quobyte-05225b3a-d74d-4886-a5f4-0e0099a3f144" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:42:46 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Deleting offline snapshot 05225b3a-d74d-4886-a5f4-0e0099a3f144 of volume 33e94f2b-c13d-48b8-9680-938c8a13e3e0 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:42:46 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] snapshot_file for this snap is: volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:42:46 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d71b042-7cfa-40d3-85c7-f62f59bbaf09]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:42:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:46 devstack sudo[89039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144 Apr 02 12:42:46 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:46 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144" returned: 0 in 0.482s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:46 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:42:46 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ae6492-b601-4d74-8d42-d2aa711d99bb]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:42:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:46 devstack sudo[89044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0 Apr 02 12:42:46 devstack sudo[89044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:47 devstack sudo[89044]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0" returned: 0 in 0.442s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:47 devstack sudo[89049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144 Apr 02 12:42:47 devstack sudo[89049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:47 devstack sudo[89049]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144" returned: 0 in 0.451s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:47 devstack sudo[89055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144 Apr 02 12:42:47 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:48 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0.05225b3a-d74d-4886-a5f4-0e0099a3f144" returned: 0 in 0.419s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:48 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-quobyte-05225b3a-d74d-4886-a5f4-0e0099a3f144" released by "_delete_snapshot" :: held 1.841s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:42:48 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-quobyte-33e94f2b-c13d-48b8-9680-938c8a13e3e0" released by "delete_snapshot" :: held 1.852s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:42:48 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Created reservations ['aa8f0d22-9959-42c1-9574-04ef92b74c79', '998b3ba8-c42c-4b99-ad77-27e9f09f5eba', '7badf2a9-b77c-42bf-a00b-4e2b7562faa7', '882abbb1-69be-43cd-b6c4-cc46ae14aa15'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:42:48 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Delete snapshot completed successfully. Apr 02 12:42:48 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-05225b3a-d74d-4886-a5f4-0e0099a3f144-delete_snapshot" released by "delete_snapshot" :: held 1.954s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:42:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Snapshots deleted, issuing volume delete {{(pid=82819) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 02 12:42:48 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "cinder-quobyte-33e94f2b-c13d-48b8-9680-938c8a13e3e0" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:42:48 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-quobyte-33e94f2b-c13d-48b8-9680-938c8a13e3e0" acquired by "delete_volume" :: waited 0.005s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:42:48 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[42886620-97fe-4948-a512-3fbb0ea823e6]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:42:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:48 devstack sudo[89058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0 Apr 02 12:42:48 devstack sudo[89058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:48 devstack sudo[89058]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0" returned: 0 in 0.460s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:48 devstack sudo[89063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0 Apr 02 12:42:48 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:49 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-33e94f2b-c13d-48b8-9680-938c8a13e3e0" returned: 0 in 0.386s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:49 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-quobyte-33e94f2b-c13d-48b8-9680-938c8a13e3e0" released by "delete_volume" :: held 0.877s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:42:49 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Created reservations ['cbe33675-3bde-4f30-b70e-38fee4c62024', '09e50415-03c3-4305-85aa-ccec450625cf', '210455a8-26ba-4a99-8a89-ed12b67f934c', 'c6ff5a1a-6f69-47f5-917d-ed7b6cafff9a'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:42:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:42:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:42:49 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:42:49 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:42:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:42:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:49 devstack sudo[89066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:42:49 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:49 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.383s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:49 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:42:49 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Deleted volume successfully. Apr 02 12:42:49 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7c0a481-402d-46c4-be76-3436578ff7d8 tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-33e94f2b-c13d-48b8-9680-938c8a13e3e0-delete_volume" released by "delete_volume" :: held 5.216s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Flow 'volume_create_manager' (af4fd2b7-9974-4bbe-a1a3-88e3b92cf095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45a1a538-f84c-4a73-874c-2bb52fbc5eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45a1a538-f84c-4a73-874c-2bb52fbc5eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2045073425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad6cf56-ce00-41fb-b4c4-51fa6d008423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba92296e03c4965a968c954fc8e1f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:42:50Z,use_quota=True,user_id='778f4b01b7bd40c59364271a0c82b74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0640b165-27de-44bb-829f-3179c55447ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0640b165-27de-44bb-829f-3179c55447ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fdede28-f18f-4995-9edd-015f5e136e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fdede28-f18f-4995-9edd-015f5e136e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ad6cf56-ce00-41fb-b4c4-51fa6d008423', 'volume_name': 'volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf7b078-1b7b-473f-bf70-de26883fdf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf7b078-1b7b-473f-bf70-de26883fdf8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33deca0b-8435-4550-b0b8-f8080910cbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:50 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Volume 9ad6cf56-ce00-41fb-b4c4-51fa6d008423: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423', 'volume_size': 1} Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2045073425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad6cf56-ce00-41fb-b4c4-51fa6d008423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba92296e03c4965a968c954fc8e1f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:42:50Z,use_quota=True,user_id='778f4b01b7bd40c59364271a0c82b74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Creating volume 9ad6cf56-ce00-41fb-b4c4-51fa6d008423 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:42:50 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:50 devstack sudo[89069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423 1073741824 Apr 02 12:42:50 devstack sudo[89069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:50 devstack sudo[89069]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423 1073741824" returned: 0 in 0.467s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:50 devstack sudo[89074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423 Apr 02 12:42:50 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:50 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423" returned: 0 in 0.374s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33deca0b-8435-4550-b0b8-f8080910cbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa75100-62df-44fa-9e47-7cf725e599e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:50 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Volume volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423 (9ad6cf56-ce00-41fb-b4c4-51fa6d008423): created successfully Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa75100-62df-44fa-9e47-7cf725e599e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Flow 'volume_create_manager' (af4fd2b7-9974-4bbe-a1a3-88e3b92cf095) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:42:51 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-ffc73e19-0035-4a9f-bfc6-3960fb9b753c tempest-VolumesDeleteCascade-1033226063 None] Created volume successfully. Apr 02 12:42:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6ae319de-7b3d-40dd-abe6-7fe011bc5c0c tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:42:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6ae319de-7b3d-40dd-abe6-7fe011bc5c0c tempest-VolumesDeleteCascade-1033226063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:42:51 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-6ae319de-7b3d-40dd-abe6-7fe011bc5c0c tempest-VolumesDeleteCascade-1033226063 None] Creating offline snapshot 91328d63-889e-4993-b930-ee26fd0b8bfd of volume 9ad6cf56-ce00-41fb-b4c4-51fa6d008423 {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:42:51 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe8886e-20ea-4ed9-8a26-5fb679d53017]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:42:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6ae319de-7b3d-40dd-abe6-7fe011bc5c0c tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:51 devstack sudo[89077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423 Apr 02 12:42:51 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:51 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6ae319de-7b3d-40dd-abe6-7fe011bc5c0c tempest-VolumesDeleteCascade-1033226063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423" returned: 0 in 0.434s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6ae319de-7b3d-40dd-abe6-7fe011bc5c0c tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.91328d63-889e-4993-b930-ee26fd0b8bfd 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:51 devstack sudo[89082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.91328d63-889e-4993-b930-ee26fd0b8bfd 1G Apr 02 12:42:51 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:52 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6ae319de-7b3d-40dd-abe6-7fe011bc5c0c tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.91328d63-889e-4993-b930-ee26fd0b8bfd 1G" returned: 0 in 0.431s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6ae319de-7b3d-40dd-abe6-7fe011bc5c0c tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.91328d63-889e-4993-b930-ee26fd0b8bfd {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:52 devstack sudo[89087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.91328d63-889e-4993-b930-ee26fd0b8bfd Apr 02 12:42:52 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:52 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6ae319de-7b3d-40dd-abe6-7fe011bc5c0c tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.91328d63-889e-4993-b930-ee26fd0b8bfd" returned: 0 in 0.416s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:52 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-6ae319de-7b3d-40dd-abe6-7fe011bc5c0c tempest-VolumesDeleteCascade-1033226063 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.91328d63-889e-4993-b930-ee26fd0b8bfd is being set with open permissions: ugo+rw Apr 02 12:42:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6ae319de-7b3d-40dd-abe6-7fe011bc5c0c tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.91328d63-889e-4993-b930-ee26fd0b8bfd {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:52 devstack sudo[89092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.91328d63-889e-4993-b930-ee26fd0b8bfd Apr 02 12:42:52 devstack sudo[89092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:52 devstack sudo[89092]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6ae319de-7b3d-40dd-abe6-7fe011bc5c0c tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.91328d63-889e-4993-b930-ee26fd0b8bfd" returned: 0 in 0.422s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6ae319de-7b3d-40dd-abe6-7fe011bc5c0c tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:52 devstack sudo[89095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.info Apr 02 12:42:52 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:53 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6ae319de-7b3d-40dd-abe6-7fe011bc5c0c tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.info" returned: 0 in 0.401s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:53 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-6ae319de-7b3d-40dd-abe6-7fe011bc5c0c tempest-VolumesDeleteCascade-1033226063 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.info is being set with open permissions: ugo+rw Apr 02 12:42:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6ae319de-7b3d-40dd-abe6-7fe011bc5c0c tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:53 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.info Apr 02 12:42:53 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:53 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6ae319de-7b3d-40dd-abe6-7fe011bc5c0c tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.info" returned: 0 in 0.384s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6ae319de-7b3d-40dd-abe6-7fe011bc5c0c tempest-VolumesDeleteCascade-1033226063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.547s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:42:53 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-6ae319de-7b3d-40dd-abe6-7fe011bc5c0c tempest-VolumesDeleteCascade-1033226063 None] Create snapshot completed successfully Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Flow 'volume_create_manager' (93840e66-2f3a-41ce-8f1b-7483fcfd4df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8245c80-d2c2-4917-b7e1-164a7344bd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8245c80-d2c2-4917-b7e1-164a7344bd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-968334162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9364e6-1c0e-437c-89e5-5ce43a5c89db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba92296e03c4965a968c954fc8e1f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=91328d63-889e-4993-b930-ee26fd0b8bfd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:42:55Z,use_quota=True,user_id='778f4b01b7bd40c59364271a0c82b74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6620c46-449f-4f31-bf0f-c6182f5a3d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6620c46-449f-4f31-bf0f-c6182f5a3d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a6da016-140f-41c0-9ed3-5e06c619d877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a6da016-140f-41c0-9ed3-5e06c619d877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'db9364e6-1c0e-437c-89e5-5ce43a5c89db', 'volume_name': 'volume-db9364e6-1c0e-437c-89e5-5ce43a5c89db', 'volume_size': 1, 'snapshot_id': '91328d63-889e-4993-b930-ee26fd0b8bfd'}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b78074-8bc9-457c-8feb-4133fde6f3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b78074-8bc9-457c-8feb-4133fde6f3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98053b96-95e5-47a5-a780-efd0dba7a700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:54 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Volume db9364e6-1c0e-437c-89e5-5ce43a5c89db: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-db9364e6-1c0e-437c-89e5-5ce43a5c89db', 'volume_size': 1, 'snapshot_id': '91328d63-889e-4993-b930-ee26fd0b8bfd'} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "cinder-quobyte-91328d63-889e-4993-b930-ee26fd0b8bfd-db9364e6-1c0e-437c-89e5-5ce43a5c89db" by "_create_volume_from_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-quobyte-91328d63-889e-4993-b930-ee26fd0b8bfd-db9364e6-1c0e-437c-89e5-5ce43a5c89db" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Creating volume db9364e6-1c0e-437c-89e5-5ce43a5c89db from snapshot 91328d63-889e-4993-b930-ee26fd0b8bfd {{(pid=82819) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "cinder-quobyte-db9364e6-1c0e-437c-89e5-5ce43a5c89db" by "_copy_volume_from_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-quobyte-db9364e6-1c0e-437c-89e5-5ce43a5c89db" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] snapshot: 91328d63-889e-4993-b930-ee26fd0b8bfd, volume: db9364e6-1c0e-437c-89e5-5ce43a5c89db, {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e445735d-824b-4e8e-9d18-80a088add2a6]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:42:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.91328d63-889e-4993-b930-ee26fd0b8bfd {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:54 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.91328d63-889e-4993-b930-ee26fd0b8bfd Apr 02 12:42:54 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:55 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.91328d63-889e-4993-b930-ee26fd0b8bfd" returned: 0 in 0.434s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:55 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:42:55 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423 {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 12:42:55 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Creating direct copy from snapshot {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 12:42:55 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[345d237b-a415-42bd-8211-d2f2ac06d473]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:42:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:55 devstack sudo[89106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423 Apr 02 12:42:55 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:55 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423" returned: 0 in 0.439s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:55 devstack cinder-volume[82819]: DEBUG cinder.utils [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Path /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-db9364e6-1c0e-437c-89e5-5ce43a5c89db not found in is_blk_device check {{(pid=82819) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 12:42:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-db9364e6-1c0e-437c-89e5-5ce43a5c89db {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:55 devstack sudo[89111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-db9364e6-1c0e-437c-89e5-5ce43a5c89db Apr 02 12:42:55 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:57 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-db9364e6-1c0e-437c-89e5-5ce43a5c89db" returned: 0 in 1.829s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:57 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[117589e2-c29e-4991-a5af-dfc9f1b6313d]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:42:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:57 devstack sudo[89157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423 Apr 02 12:42:57 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:57 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423" returned: 0 in 0.558s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:57 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423, size 1024.00 MB, duration 1.83 sec, destination /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-db9364e6-1c0e-437c-89e5-5ce43a5c89db {{(pid=82819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 12:42:57 devstack cinder-volume[82819]: INFO cinder.image.image_utils [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Converted 1024.00 MB image at 559.60 MB/s Apr 02 12:42:57 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-db9364e6-1c0e-437c-89e5-5ce43a5c89db is being set with open permissions: ugo+rw Apr 02 12:42:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-db9364e6-1c0e-437c-89e5-5ce43a5c89db {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:58 devstack sudo[89163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-db9364e6-1c0e-437c-89e5-5ce43a5c89db Apr 02 12:42:58 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:58 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-db9364e6-1c0e-437c-89e5-5ce43a5c89db" returned: 0 in 0.369s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:58 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-quobyte-db9364e6-1c0e-437c-89e5-5ce43a5c89db" released by "_copy_volume_from_snapshot" :: held 3.678s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:42:58 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-quobyte-91328d63-889e-4993-b930-ee26fd0b8bfd-db9364e6-1c0e-437c-89e5-5ce43a5c89db" released by "_create_volume_from_snapshot" :: held 3.695s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:42:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.703s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:42:58 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:SELECT=84,cinder:INSERT=22,cinder:UPDATE=104,cinder:DELETE=8 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:42:58 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:SELECT=74,cinder:INSERT=27,cinder:UPDATE=86,cinder:DELETE=8 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:42:58 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98053b96-95e5-47a5-a780-efd0dba7a700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db9364e6-1c0e-437c-89e5-5ce43a5c89db', 'volume_size': 1, 'snapshot_id': '91328d63-889e-4993-b930-ee26fd0b8bfd'}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:58 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058bc9a4-4648-4b47-b514-07fdc2233613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:42:58 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Volume volume-db9364e6-1c0e-437c-89e5-5ce43a5c89db (db9364e6-1c0e-437c-89e5-5ce43a5c89db): created successfully Apr 02 12:42:58 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058bc9a4-4648-4b47-b514-07fdc2233613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:42:58 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Flow 'volume_create_manager' (93840e66-2f3a-41ce-8f1b-7483fcfd4df5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:42:58 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-82c63e19-ebe7-4f8d-b280-0143733f35b2 tempest-VolumesDeleteCascade-1033226063 None] Created volume successfully. Apr 02 12:42:58 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "cinder-9ad6cf56-ce00-41fb-b4c4-51fa6d008423-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:42:58 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-9ad6cf56-ce00-41fb-b4c4-51fa6d008423-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:42:58 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Performing cascade delete. {{(pid=82819) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 02 12:42:58 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "cinder-91328d63-889e-4993-b930-ee26fd0b8bfd-delete_snapshot" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:42:58 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-91328d63-889e-4993-b930-ee26fd0b8bfd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:42:58 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "cinder-quobyte-9ad6cf56-ce00-41fb-b4c4-51fa6d008423" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:42:58 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-quobyte-9ad6cf56-ce00-41fb-b4c4-51fa6d008423" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:42:58 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "cinder-quobyte-91328d63-889e-4993-b930-ee26fd0b8bfd" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:42:58 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-quobyte-91328d63-889e-4993-b930-ee26fd0b8bfd" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:42:58 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Deleting offline snapshot 91328d63-889e-4993-b930-ee26fd0b8bfd of volume 9ad6cf56-ce00-41fb-b4c4-51fa6d008423 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:42:58 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] snapshot_file for this snap is: volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.91328d63-889e-4993-b930-ee26fd0b8bfd {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:42:58 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfdb463-3889-4c94-9cfe-c3f6ead4a4f7]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:42:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.91328d63-889e-4993-b930-ee26fd0b8bfd {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:59 devstack sudo[89166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.91328d63-889e-4993-b930-ee26fd0b8bfd Apr 02 12:42:59 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:59 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.91328d63-889e-4993-b930-ee26fd0b8bfd" returned: 0 in 0.421s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:59 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:42:59 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b80829-7227-47c3-9477-3ef3b980d1a6]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:42:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:59 devstack sudo[89171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423 Apr 02 12:42:59 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:42:59 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root Apr 02 12:42:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423" returned: 0 in 0.424s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:42:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.91328d63-889e-4993-b930-ee26fd0b8bfd {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:42:59 devstack sudo[89176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.91328d63-889e-4993-b930-ee26fd0b8bfd Apr 02 12:42:59 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:00 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.91328d63-889e-4993-b930-ee26fd0b8bfd" returned: 0 in 0.405s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.91328d63-889e-4993-b930-ee26fd0b8bfd {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:00 devstack sudo[89181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.91328d63-889e-4993-b930-ee26fd0b8bfd Apr 02 12:43:00 devstack sudo[89181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:00 devstack sudo[89181]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423.91328d63-889e-4993-b930-ee26fd0b8bfd" returned: 0 in 0.367s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-quobyte-91328d63-889e-4993-b930-ee26fd0b8bfd" released by "_delete_snapshot" :: held 1.661s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:43:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-quobyte-9ad6cf56-ce00-41fb-b4c4-51fa6d008423" released by "delete_snapshot" :: held 1.672s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:43:00 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Created reservations ['623e0ea0-8e7c-496d-845b-bc58aeccdb0b', '2f2c9868-caa6-4c51-b774-d136891e87c6', '5c2e6976-fe24-41da-9d6d-a081ba055561', '433d846b-33b2-47f1-a2bf-0e011c58293a'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:43:00 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Delete snapshot completed successfully. Apr 02 12:43:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-91328d63-889e-4993-b930-ee26fd0b8bfd-delete_snapshot" released by "delete_snapshot" :: held 1.759s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:43:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Snapshots deleted, issuing volume delete {{(pid=82819) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 02 12:43:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "cinder-quobyte-9ad6cf56-ce00-41fb-b4c4-51fa6d008423" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:43:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-quobyte-9ad6cf56-ce00-41fb-b4c4-51fa6d008423" acquired by "delete_volume" :: waited 0.006s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:43:00 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82a19d7-7dd5-4a99-8b2c-01095a739eb9]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:43:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:00 devstack sudo[89184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423 Apr 02 12:43:00 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:01 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423" returned: 0 in 0.421s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:01 devstack sudo[89189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423 Apr 02 12:43:01 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:01 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ad6cf56-ce00-41fb-b4c4-51fa6d008423" returned: 0 in 0.361s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:01 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-quobyte-9ad6cf56-ce00-41fb-b4c4-51fa6d008423" released by "delete_volume" :: held 0.808s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:43:01 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Created reservations ['48c635b5-a060-426a-88a1-2be538133740', 'dc1ecdb7-e2a1-4f0a-856f-35e79e248ab0', '79159c0b-6909-4f79-8f31-e6dec1a5a898', '9b4ebdd4-1f7e-4bc9-9073-1a8936e53e77'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:43:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:43:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:43:01 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:43:01 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:43:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:43:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:01 devstack sudo[89192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:43:01 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:01 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.391s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:01 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:43:01 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Deleted volume successfully. Apr 02 12:43:01 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-62dc5d8f-1112-4d82-8bc4-38793a39735f tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-9ad6cf56-ce00-41fb-b4c4-51fa6d008423-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:43:02 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-106ad215-1071-4f43-8212-8653111945e3 tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "cinder-db9364e6-1c0e-437c-89e5-5ce43a5c89db-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:43:02 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-106ad215-1071-4f43-8212-8653111945e3 tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-db9364e6-1c0e-437c-89e5-5ce43a5c89db-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:43:02 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-106ad215-1071-4f43-8212-8653111945e3 tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "cinder-quobyte-db9364e6-1c0e-437c-89e5-5ce43a5c89db" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:43:02 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-106ad215-1071-4f43-8212-8653111945e3 tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-quobyte-db9364e6-1c0e-437c-89e5-5ce43a5c89db" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:43:02 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0502acfe-a791-48ab-961b-05305a278b34]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:43:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-106ad215-1071-4f43-8212-8653111945e3 tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-db9364e6-1c0e-437c-89e5-5ce43a5c89db {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:02 devstack sudo[89195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-db9364e6-1c0e-437c-89e5-5ce43a5c89db Apr 02 12:43:02 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:02 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-106ad215-1071-4f43-8212-8653111945e3 tempest-VolumesDeleteCascade-1033226063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-db9364e6-1c0e-437c-89e5-5ce43a5c89db" returned: 0 in 0.498s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-106ad215-1071-4f43-8212-8653111945e3 tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-db9364e6-1c0e-437c-89e5-5ce43a5c89db {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:02 devstack sudo[89201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-db9364e6-1c0e-437c-89e5-5ce43a5c89db Apr 02 12:43:02 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:03 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-106ad215-1071-4f43-8212-8653111945e3 tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-db9364e6-1c0e-437c-89e5-5ce43a5c89db" returned: 0 in 0.389s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:03 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-106ad215-1071-4f43-8212-8653111945e3 tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-quobyte-db9364e6-1c0e-437c-89e5-5ce43a5c89db" released by "delete_volume" :: held 0.916s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:43:03 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-106ad215-1071-4f43-8212-8653111945e3 tempest-VolumesDeleteCascade-1033226063 None] Created reservations ['5d067289-ccd1-4d30-aae6-48d452b8d666', '13dcd6f5-3270-4a79-8115-47eba7a84d84', '54126469-10c9-4866-8d4f-44576e1cc6ad', 'f73d997a-9ca1-4d43-8e03-7fd8b3974b0d'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:43:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-106ad215-1071-4f43-8212-8653111945e3 tempest-VolumesDeleteCascade-1033226063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:43:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-106ad215-1071-4f43-8212-8653111945e3 tempest-VolumesDeleteCascade-1033226063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:43:03 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-106ad215-1071-4f43-8212-8653111945e3 tempest-VolumesDeleteCascade-1033226063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:43:03 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-106ad215-1071-4f43-8212-8653111945e3 tempest-VolumesDeleteCascade-1033226063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:43:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-106ad215-1071-4f43-8212-8653111945e3 tempest-VolumesDeleteCascade-1033226063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:43:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-106ad215-1071-4f43-8212-8653111945e3 tempest-VolumesDeleteCascade-1033226063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:03 devstack sudo[89204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:43:03 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:03 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-106ad215-1071-4f43-8212-8653111945e3 tempest-VolumesDeleteCascade-1033226063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.424s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:03 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-106ad215-1071-4f43-8212-8653111945e3 tempest-VolumesDeleteCascade-1033226063 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:43:03 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-106ad215-1071-4f43-8212-8653111945e3 tempest-VolumesDeleteCascade-1033226063 None] Deleted volume successfully. Apr 02 12:43:03 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-106ad215-1071-4f43-8212-8653111945e3 tempest-VolumesDeleteCascade-1033226063 None] Lock "cinder-db9364e6-1c0e-437c-89e5-5ce43a5c89db-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:43:05 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:43:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Flow 'volume_create_manager' (daa96a22-7f24-4d5f-a047-5277443174f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:43:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4967c010-f9f3-4e5b-9624-5065e9cbda34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4967c010-f9f3-4e5b-9624-5065e9cbda34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-581126435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4597b762-0a9b-4f2a-b4c2-6ff200e82c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9a625ccb3d403e8e3bd20ba93947b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:43:06Z,use_quota=True,user_id='70554ef7332349aca46a60ff2c12feba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64b8415b-fb0b-40b1-8913-bc55bf04042f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64b8415b-fb0b-40b1-8913-bc55bf04042f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e54e2e6a-8698-4710-a8d4-04acd6955dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e54e2e6a-8698-4710-a8d4-04acd6955dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4597b762-0a9b-4f2a-b4c2-6ff200e82c38', 'volume_name': 'volume-4597b762-0a9b-4f2a-b4c2-6ff200e82c38', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (328a55f7-80f4-4cec-8f03-0e47d2ba41ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (328a55f7-80f4-4cec-8f03-0e47d2ba41ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca1dd37-e9f5-4a1f-babf-bd7cf68a5064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:05 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Volume 4597b762-0a9b-4f2a-b4c2-6ff200e82c38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4597b762-0a9b-4f2a-b4c2-6ff200e82c38', 'volume_size': 1} Apr 02 12:43:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:43:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:43:05 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-581126435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4597b762-0a9b-4f2a-b4c2-6ff200e82c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9a625ccb3d403e8e3bd20ba93947b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:43:06Z,use_quota=True,user_id='70554ef7332349aca46a60ff2c12feba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:43:05 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Creating volume 4597b762-0a9b-4f2a-b4c2-6ff200e82c38 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:43:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:43:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:43:05 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:43:05 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:43:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:43:05 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:43:05 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:43:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-4597b762-0a9b-4f2a-b4c2-6ff200e82c38 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:05 devstack sudo[89208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-4597b762-0a9b-4f2a-b4c2-6ff200e82c38 1073741824 Apr 02 12:43:05 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:06 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-4597b762-0a9b-4f2a-b4c2-6ff200e82c38 1073741824" returned: 0 in 0.451s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-4597b762-0a9b-4f2a-b4c2-6ff200e82c38 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:06 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-4597b762-0a9b-4f2a-b4c2-6ff200e82c38 Apr 02 12:43:06 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:06 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-4597b762-0a9b-4f2a-b4c2-6ff200e82c38" returned: 0 in 0.386s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:06 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:43:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:43:06 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca1dd37-e9f5-4a1f-babf-bd7cf68a5064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4597b762-0a9b-4f2a-b4c2-6ff200e82c38', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:06 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2800142a-1754-4498-976e-7fe25ae709a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:06 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Volume volume-4597b762-0a9b-4f2a-b4c2-6ff200e82c38 (4597b762-0a9b-4f2a-b4c2-6ff200e82c38): created successfully Apr 02 12:43:06 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2800142a-1754-4498-976e-7fe25ae709a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:06 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Flow 'volume_create_manager' (daa96a22-7f24-4d5f-a047-5277443174f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:43:06 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-291da63c-e7ed-4c4e-876b-03ddc8a3bb38 tempest-VolumesTransfersTest-1736689417 None] Created volume successfully. Apr 02 12:43:07 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-2ee3b626-84e7-4e27-b64c-ed9771f9c6a4 tempest-VolumesTransfersTest-1932148720 None] Transfer volume completed successfully. Apr 02 12:43:07 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-66b6a0ae-5b09-406b-977a-c6d9f1c9d9cf tempest-VolumesTransfersTest-644887214 None] Acquiring lock "cinder-4597b762-0a9b-4f2a-b4c2-6ff200e82c38-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:43:07 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-66b6a0ae-5b09-406b-977a-c6d9f1c9d9cf tempest-VolumesTransfersTest-644887214 None] Lock "cinder-4597b762-0a9b-4f2a-b4c2-6ff200e82c38-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:43:07 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-66b6a0ae-5b09-406b-977a-c6d9f1c9d9cf tempest-VolumesTransfersTest-644887214 None] Acquiring lock "cinder-quobyte-4597b762-0a9b-4f2a-b4c2-6ff200e82c38" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:43:07 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-66b6a0ae-5b09-406b-977a-c6d9f1c9d9cf tempest-VolumesTransfersTest-644887214 None] Lock "cinder-quobyte-4597b762-0a9b-4f2a-b4c2-6ff200e82c38" acquired by "delete_volume" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:43:07 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[1068531a-f0ff-49fc-b52d-4a2763697dbb]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:43:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-66b6a0ae-5b09-406b-977a-c6d9f1c9d9cf tempest-VolumesTransfersTest-644887214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-4597b762-0a9b-4f2a-b4c2-6ff200e82c38 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:08 devstack sudo[89217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-4597b762-0a9b-4f2a-b4c2-6ff200e82c38 Apr 02 12:43:08 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:08 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-66b6a0ae-5b09-406b-977a-c6d9f1c9d9cf tempest-VolumesTransfersTest-644887214 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-4597b762-0a9b-4f2a-b4c2-6ff200e82c38" returned: 0 in 0.477s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-66b6a0ae-5b09-406b-977a-c6d9f1c9d9cf tempest-VolumesTransfersTest-644887214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-4597b762-0a9b-4f2a-b4c2-6ff200e82c38 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:08 devstack sudo[89222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-4597b762-0a9b-4f2a-b4c2-6ff200e82c38 Apr 02 12:43:08 devstack sudo[89222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:08 devstack sudo[89222]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-66b6a0ae-5b09-406b-977a-c6d9f1c9d9cf tempest-VolumesTransfersTest-644887214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-4597b762-0a9b-4f2a-b4c2-6ff200e82c38" returned: 0 in 0.393s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:08 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-66b6a0ae-5b09-406b-977a-c6d9f1c9d9cf tempest-VolumesTransfersTest-644887214 None] Lock "cinder-quobyte-4597b762-0a9b-4f2a-b4c2-6ff200e82c38" released by "delete_volume" :: held 0.893s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:43:08 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-66b6a0ae-5b09-406b-977a-c6d9f1c9d9cf tempest-VolumesTransfersTest-644887214 None] Created reservations ['a231428a-92b6-4b38-aec4-74a36f86a51c', 'b6bd2e9b-060f-46c0-a51b-e1d572fa2cc4', '9ad4f071-c333-49a7-ad51-0a455e679e39', '3c12c448-494d-4a03-901e-854c7ff79465'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:43:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-66b6a0ae-5b09-406b-977a-c6d9f1c9d9cf tempest-VolumesTransfersTest-644887214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:43:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-66b6a0ae-5b09-406b-977a-c6d9f1c9d9cf tempest-VolumesTransfersTest-644887214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:43:08 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-66b6a0ae-5b09-406b-977a-c6d9f1c9d9cf tempest-VolumesTransfersTest-644887214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:43:08 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-66b6a0ae-5b09-406b-977a-c6d9f1c9d9cf tempest-VolumesTransfersTest-644887214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:43:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-66b6a0ae-5b09-406b-977a-c6d9f1c9d9cf tempest-VolumesTransfersTest-644887214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:43:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-66b6a0ae-5b09-406b-977a-c6d9f1c9d9cf tempest-VolumesTransfersTest-644887214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:08 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:43:08 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:09 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:43:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Flow 'volume_create_manager' (8aa566f5-58a1-4a6f-b01e-37ee9bc35b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:43:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b531db57-3a7d-40b2-bc0d-aa3fb830be9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b531db57-3a7d-40b2-bc0d-aa3fb830be9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-25929782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c68a99-eb77-4f5e-9531-d4b36186ff82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9a625ccb3d403e8e3bd20ba93947b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:43:09Z,use_quota=True,user_id='70554ef7332349aca46a60ff2c12feba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa6dbac-a84c-40be-a4e8-344713dfe6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa6dbac-a84c-40be-a4e8-344713dfe6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f99f9b0-f3f9-4a9d-a8fd-af6f762aaef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f99f9b0-f3f9-4a9d-a8fd-af6f762aaef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44c68a99-eb77-4f5e-9531-d4b36186ff82', 'volume_name': 'volume-44c68a99-eb77-4f5e-9531-d4b36186ff82', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eab59d8-111e-4e23-a7b6-044f35bbab06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eab59d8-111e-4e23-a7b6-044f35bbab06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:09 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dce8ecf-1324-4b86-827f-0ef03a328835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:09 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Volume 44c68a99-eb77-4f5e-9531-d4b36186ff82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44c68a99-eb77-4f5e-9531-d4b36186ff82', 'volume_size': 1} Apr 02 12:43:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:43:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:43:09 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-25929782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c68a99-eb77-4f5e-9531-d4b36186ff82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9a625ccb3d403e8e3bd20ba93947b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:43:09Z,use_quota=True,user_id='70554ef7332349aca46a60ff2c12feba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:43:09 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Creating volume 44c68a99-eb77-4f5e-9531-d4b36186ff82 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:43:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:43:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:43:09 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:43:09 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:43:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:43:09 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:43:09 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:43:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-44c68a99-eb77-4f5e-9531-d4b36186ff82 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:09 devstack sudo[89230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-44c68a99-eb77-4f5e-9531-d4b36186ff82 1073741824 Apr 02 12:43:09 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:09 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-66b6a0ae-5b09-406b-977a-c6d9f1c9d9cf tempest-VolumesTransfersTest-644887214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.471s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:09 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-66b6a0ae-5b09-406b-977a-c6d9f1c9d9cf tempest-VolumesTransfersTest-644887214 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:43:09 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-66b6a0ae-5b09-406b-977a-c6d9f1c9d9cf tempest-VolumesTransfersTest-644887214 None] Deleted volume successfully. Apr 02 12:43:09 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-66b6a0ae-5b09-406b-977a-c6d9f1c9d9cf tempest-VolumesTransfersTest-644887214 None] Lock "cinder-4597b762-0a9b-4f2a-b4c2-6ff200e82c38-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:43:09 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-44c68a99-eb77-4f5e-9531-d4b36186ff82 1073741824" returned: 0 in 0.464s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-44c68a99-eb77-4f5e-9531-d4b36186ff82 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:09 devstack sudo[89235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-44c68a99-eb77-4f5e-9531-d4b36186ff82 Apr 02 12:43:09 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:10 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-44c68a99-eb77-4f5e-9531-d4b36186ff82" returned: 0 in 0.368s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:10 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:43:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:43:10 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dce8ecf-1324-4b86-827f-0ef03a328835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44c68a99-eb77-4f5e-9531-d4b36186ff82', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:10 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5668a5fe-f525-4ca6-a8e2-3d1e45003251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:10 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Volume volume-44c68a99-eb77-4f5e-9531-d4b36186ff82 (44c68a99-eb77-4f5e-9531-d4b36186ff82): created successfully Apr 02 12:43:10 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5668a5fe-f525-4ca6-a8e2-3d1e45003251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:10 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Flow 'volume_create_manager' (8aa566f5-58a1-4a6f-b01e-37ee9bc35b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:43:10 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-923253ab-fa2c-4412-b708-0c115b9a030d tempest-VolumesTransfersTest-1736689417 None] Created volume successfully. Apr 02 12:43:10 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7adf3dbf-bbb2-47fe-9830-beb6216f2e98 tempest-VolumesTransfersTest-644887214 None] Acquiring lock "cinder-44c68a99-eb77-4f5e-9531-d4b36186ff82-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:43:10 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7adf3dbf-bbb2-47fe-9830-beb6216f2e98 tempest-VolumesTransfersTest-644887214 None] Lock "cinder-44c68a99-eb77-4f5e-9531-d4b36186ff82-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:43:10 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7adf3dbf-bbb2-47fe-9830-beb6216f2e98 tempest-VolumesTransfersTest-644887214 None] Acquiring lock "cinder-quobyte-44c68a99-eb77-4f5e-9531-d4b36186ff82" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:43:10 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7adf3dbf-bbb2-47fe-9830-beb6216f2e98 tempest-VolumesTransfersTest-644887214 None] Lock "cinder-quobyte-44c68a99-eb77-4f5e-9531-d4b36186ff82" acquired by "delete_volume" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:43:10 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54e4f28-e2f8-44a6-8bc2-0927570c7d3a]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:43:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7adf3dbf-bbb2-47fe-9830-beb6216f2e98 tempest-VolumesTransfersTest-644887214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-44c68a99-eb77-4f5e-9531-d4b36186ff82 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:10 devstack sudo[89238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-44c68a99-eb77-4f5e-9531-d4b36186ff82 Apr 02 12:43:10 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:11 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7adf3dbf-bbb2-47fe-9830-beb6216f2e98 tempest-VolumesTransfersTest-644887214 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-44c68a99-eb77-4f5e-9531-d4b36186ff82" returned: 0 in 0.464s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7adf3dbf-bbb2-47fe-9830-beb6216f2e98 tempest-VolumesTransfersTest-644887214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-44c68a99-eb77-4f5e-9531-d4b36186ff82 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:11 devstack sudo[89243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-44c68a99-eb77-4f5e-9531-d4b36186ff82 Apr 02 12:43:11 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:11 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7adf3dbf-bbb2-47fe-9830-beb6216f2e98 tempest-VolumesTransfersTest-644887214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-44c68a99-eb77-4f5e-9531-d4b36186ff82" returned: 0 in 0.392s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:11 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7adf3dbf-bbb2-47fe-9830-beb6216f2e98 tempest-VolumesTransfersTest-644887214 None] Lock "cinder-quobyte-44c68a99-eb77-4f5e-9531-d4b36186ff82" released by "delete_volume" :: held 0.880s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:43:11 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-7adf3dbf-bbb2-47fe-9830-beb6216f2e98 tempest-VolumesTransfersTest-644887214 None] Created reservations ['6a929b8a-b693-4e5c-b910-eefac59c4fcf', '11e31f47-7a23-4cf8-a8dd-d85a1729f1e0', '7a3b361b-0ab5-46a1-9d64-b912f9f8b874', 'dd5f72e3-60b1-4d7e-8094-1917052c65d5'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:43:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7adf3dbf-bbb2-47fe-9830-beb6216f2e98 tempest-VolumesTransfersTest-644887214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:43:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7adf3dbf-bbb2-47fe-9830-beb6216f2e98 tempest-VolumesTransfersTest-644887214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:43:11 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7adf3dbf-bbb2-47fe-9830-beb6216f2e98 tempest-VolumesTransfersTest-644887214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:43:11 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7adf3dbf-bbb2-47fe-9830-beb6216f2e98 tempest-VolumesTransfersTest-644887214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:43:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7adf3dbf-bbb2-47fe-9830-beb6216f2e98 tempest-VolumesTransfersTest-644887214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:43:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7adf3dbf-bbb2-47fe-9830-beb6216f2e98 tempest-VolumesTransfersTest-644887214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:11 devstack sudo[89246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:43:11 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:12 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7adf3dbf-bbb2-47fe-9830-beb6216f2e98 tempest-VolumesTransfersTest-644887214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.459s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:12 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-7adf3dbf-bbb2-47fe-9830-beb6216f2e98 tempest-VolumesTransfersTest-644887214 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:43:12 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-7adf3dbf-bbb2-47fe-9830-beb6216f2e98 tempest-VolumesTransfersTest-644887214 None] Deleted volume successfully. Apr 02 12:43:12 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7adf3dbf-bbb2-47fe-9830-beb6216f2e98 tempest-VolumesTransfersTest-644887214 None] Lock "cinder-44c68a99-eb77-4f5e-9531-d4b36186ff82-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:43:13 devstack cinder-volume[82819]: DEBUG oslo_service.periodic_task [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82819) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 12:43:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:43:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:43:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:43:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:43:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:43:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:13 devstack sudo[89249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:43:13 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:13 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.461s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:13 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:43:15 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:43:15 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Flow 'volume_create_manager' (a4b3d6f3-2283-490e-acb6-48e63f65f242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:43:15 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acec3a12-c824-402d-89bb-e8905e74fd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:15 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acec3a12-c824-402d-89bb-e8905e74fd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-572010413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a8faf6e-5320-467d-a638-8e0f5115717e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d82da0aa2ad413c8ed945f952d58dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:43:16Z,use_quota=True,user_id='a98a583ddceb4110b7fdd92a78853d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:15 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd56ce53-a4b0-4513-95b4-6192f836f08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:15 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd56ce53-a4b0-4513-95b4-6192f836f08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:15 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (295f3112-8d9d-4919-a1f5-1a709ff3b531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:15 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (295f3112-8d9d-4919-a1f5-1a709ff3b531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a8faf6e-5320-467d-a638-8e0f5115717e', 'volume_name': 'volume-7a8faf6e-5320-467d-a638-8e0f5115717e', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:15 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34fc2ba-a2c1-479a-97e8-a435eca218cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:15 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34fc2ba-a2c1-479a-97e8-a435eca218cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:15 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (328714ce-c13a-429b-89f4-f4e37fdb9f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:15 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Volume 7a8faf6e-5320-467d-a638-8e0f5115717e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a8faf6e-5320-467d-a638-8e0f5115717e', 'volume_size': 1} Apr 02 12:43:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:43:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:43:15 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-572010413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a8faf6e-5320-467d-a638-8e0f5115717e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d82da0aa2ad413c8ed945f952d58dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:43:16Z,use_quota=True,user_id='a98a583ddceb4110b7fdd92a78853d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:43:15 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Creating volume 7a8faf6e-5320-467d-a638-8e0f5115717e {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:43:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:43:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:43:15 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:43:15 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:43:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:43:15 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:43:15 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:43:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7a8faf6e-5320-467d-a638-8e0f5115717e 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:15 devstack sudo[89252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7a8faf6e-5320-467d-a638-8e0f5115717e 1073741824 Apr 02 12:43:15 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:16 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7a8faf6e-5320-467d-a638-8e0f5115717e 1073741824" returned: 0 in 0.447s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7a8faf6e-5320-467d-a638-8e0f5115717e {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:16 devstack sudo[89257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7a8faf6e-5320-467d-a638-8e0f5115717e Apr 02 12:43:16 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:16 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7a8faf6e-5320-467d-a638-8e0f5115717e" returned: 0 in 0.408s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:16 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:43:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:43:16 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (328714ce-c13a-429b-89f4-f4e37fdb9f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a8faf6e-5320-467d-a638-8e0f5115717e', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:16 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61ae0516-ab54-42e1-8f0e-c19c80a30145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:16 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Volume volume-7a8faf6e-5320-467d-a638-8e0f5115717e (7a8faf6e-5320-467d-a638-8e0f5115717e): created successfully Apr 02 12:43:16 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61ae0516-ab54-42e1-8f0e-c19c80a30145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:16 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Flow 'volume_create_manager' (a4b3d6f3-2283-490e-acb6-48e63f65f242) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:43:16 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-79d05008-2a8a-491e-a7aa-3af7db562b95 tempest-VolumesTransfersV357Test-940296238 None] Created volume successfully. Apr 02 12:43:17 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-1d3cdb61-50b1-4ad4-9ade-42f85f3d76a3 tempest-VolumesTransfersV357Test-42236484 None] Transfer volume completed successfully. Apr 02 12:43:17 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-95f48887-fd9a-489a-b634-b8120e0da69e tempest-VolumesTransfersV357Test-647211288 None] Acquiring lock "cinder-7a8faf6e-5320-467d-a638-8e0f5115717e-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:43:17 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-95f48887-fd9a-489a-b634-b8120e0da69e tempest-VolumesTransfersV357Test-647211288 None] Lock "cinder-7a8faf6e-5320-467d-a638-8e0f5115717e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:43:17 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-95f48887-fd9a-489a-b634-b8120e0da69e tempest-VolumesTransfersV357Test-647211288 None] Acquiring lock "cinder-quobyte-7a8faf6e-5320-467d-a638-8e0f5115717e" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:43:17 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-95f48887-fd9a-489a-b634-b8120e0da69e tempest-VolumesTransfersV357Test-647211288 None] Lock "cinder-quobyte-7a8faf6e-5320-467d-a638-8e0f5115717e" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:43:18 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b54c12-411e-4462-a7b6-59e0b8cd143d]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:43:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-95f48887-fd9a-489a-b634-b8120e0da69e tempest-VolumesTransfersV357Test-647211288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7a8faf6e-5320-467d-a638-8e0f5115717e {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:18 devstack sudo[89261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7a8faf6e-5320-467d-a638-8e0f5115717e Apr 02 12:43:18 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:18 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-95f48887-fd9a-489a-b634-b8120e0da69e tempest-VolumesTransfersV357Test-647211288 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7a8faf6e-5320-467d-a638-8e0f5115717e" returned: 0 in 0.498s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-95f48887-fd9a-489a-b634-b8120e0da69e tempest-VolumesTransfersV357Test-647211288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7a8faf6e-5320-467d-a638-8e0f5115717e {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:18 devstack sudo[89266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7a8faf6e-5320-467d-a638-8e0f5115717e Apr 02 12:43:18 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:18 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-95f48887-fd9a-489a-b634-b8120e0da69e tempest-VolumesTransfersV357Test-647211288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-7a8faf6e-5320-467d-a638-8e0f5115717e" returned: 0 in 0.397s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-95f48887-fd9a-489a-b634-b8120e0da69e tempest-VolumesTransfersV357Test-647211288 None] Lock "cinder-quobyte-7a8faf6e-5320-467d-a638-8e0f5115717e" released by "delete_volume" :: held 0.922s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:43:18 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-95f48887-fd9a-489a-b634-b8120e0da69e tempest-VolumesTransfersV357Test-647211288 None] Created reservations ['6a159bce-d1e4-486d-8571-9c0e4f107663', '05f32a16-5fda-48b5-9018-6046cf457ac6', 'e22bcd04-2ff1-41dc-9214-e702eed03e95', '8b461349-6220-4984-b62b-80ed3b5ea149'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:43:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-95f48887-fd9a-489a-b634-b8120e0da69e tempest-VolumesTransfersV357Test-647211288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:43:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-95f48887-fd9a-489a-b634-b8120e0da69e tempest-VolumesTransfersV357Test-647211288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:43:18 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-95f48887-fd9a-489a-b634-b8120e0da69e tempest-VolumesTransfersV357Test-647211288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:43:18 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-95f48887-fd9a-489a-b634-b8120e0da69e tempest-VolumesTransfersV357Test-647211288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:43:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-95f48887-fd9a-489a-b634-b8120e0da69e tempest-VolumesTransfersV357Test-647211288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:43:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-95f48887-fd9a-489a-b634-b8120e0da69e tempest-VolumesTransfersV357Test-647211288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:19 devstack sudo[89269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:43:19 devstack sudo[89269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:19 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:43:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Flow 'volume_create_manager' (56be0e5c-0120-4f90-a25f-259f84e3799d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:43:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4fb0efe-c478-4b24-95a4-a1d76f8099ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4fb0efe-c478-4b24-95a4-a1d76f8099ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-281224182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01a580f-aaaa-4b8a-a988-c05a9058a2f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d82da0aa2ad413c8ed945f952d58dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:43:19Z,use_quota=True,user_id='a98a583ddceb4110b7fdd92a78853d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23dc8053-b647-493d-922a-6638146d1467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23dc8053-b647-493d-922a-6638146d1467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be71b2af-4423-44e8-b954-27156225abe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be71b2af-4423-44e8-b954-27156225abe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a01a580f-aaaa-4b8a-a988-c05a9058a2f6', 'volume_name': 'volume-a01a580f-aaaa-4b8a-a988-c05a9058a2f6', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4209d9-4a67-45cf-a915-4c1e51a9bb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4209d9-4a67-45cf-a915-4c1e51a9bb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebdb7ae2-9586-46e9-86f0-3081c1dff60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:19 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Volume a01a580f-aaaa-4b8a-a988-c05a9058a2f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a01a580f-aaaa-4b8a-a988-c05a9058a2f6', 'volume_size': 1} Apr 02 12:43:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:43:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:43:19 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-281224182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01a580f-aaaa-4b8a-a988-c05a9058a2f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d82da0aa2ad413c8ed945f952d58dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:43:19Z,use_quota=True,user_id='a98a583ddceb4110b7fdd92a78853d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:43:19 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Creating volume a01a580f-aaaa-4b8a-a988-c05a9058a2f6 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:43:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:43:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:43:19 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:43:19 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:43:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:43:19 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:43:19 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:43:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a01a580f-aaaa-4b8a-a988-c05a9058a2f6 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:19 devstack sudo[89272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a01a580f-aaaa-4b8a-a988-c05a9058a2f6 1073741824 Apr 02 12:43:19 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:19 devstack sudo[89269]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-95f48887-fd9a-489a-b634-b8120e0da69e tempest-VolumesTransfersV357Test-647211288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.485s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:19 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-95f48887-fd9a-489a-b634-b8120e0da69e tempest-VolumesTransfersV357Test-647211288 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:43:19 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-95f48887-fd9a-489a-b634-b8120e0da69e tempest-VolumesTransfersV357Test-647211288 None] Deleted volume successfully. Apr 02 12:43:19 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-95f48887-fd9a-489a-b634-b8120e0da69e tempest-VolumesTransfersV357Test-647211288 None] Lock "cinder-7a8faf6e-5320-467d-a638-8e0f5115717e-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:43:19 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a01a580f-aaaa-4b8a-a988-c05a9058a2f6 1073741824" returned: 0 in 0.486s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a01a580f-aaaa-4b8a-a988-c05a9058a2f6 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:19 devstack sudo[89279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a01a580f-aaaa-4b8a-a988-c05a9058a2f6 Apr 02 12:43:19 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:20 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a01a580f-aaaa-4b8a-a988-c05a9058a2f6" returned: 0 in 0.396s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:20 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:43:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:43:20 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebdb7ae2-9586-46e9-86f0-3081c1dff60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a01a580f-aaaa-4b8a-a988-c05a9058a2f6', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:20 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db51c3a2-020a-4e39-8d1b-fca811a81688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:20 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Volume volume-a01a580f-aaaa-4b8a-a988-c05a9058a2f6 (a01a580f-aaaa-4b8a-a988-c05a9058a2f6): created successfully Apr 02 12:43:20 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db51c3a2-020a-4e39-8d1b-fca811a81688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:20 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Flow 'volume_create_manager' (56be0e5c-0120-4f90-a25f-259f84e3799d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:43:20 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-93dbdca4-beb8-4762-85cc-d0cee8e36b84 tempest-VolumesTransfersV357Test-940296238 None] Created volume successfully. Apr 02 12:43:21 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-71814fdc-e3f6-4f4c-ab1a-338559ab1f54 tempest-VolumesTransfersV357Test-647211288 None] Acquiring lock "cinder-a01a580f-aaaa-4b8a-a988-c05a9058a2f6-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:43:21 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-71814fdc-e3f6-4f4c-ab1a-338559ab1f54 tempest-VolumesTransfersV357Test-647211288 None] Lock "cinder-a01a580f-aaaa-4b8a-a988-c05a9058a2f6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:43:21 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-71814fdc-e3f6-4f4c-ab1a-338559ab1f54 tempest-VolumesTransfersV357Test-647211288 None] Acquiring lock "cinder-quobyte-a01a580f-aaaa-4b8a-a988-c05a9058a2f6" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:43:21 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-71814fdc-e3f6-4f4c-ab1a-338559ab1f54 tempest-VolumesTransfersV357Test-647211288 None] Lock "cinder-quobyte-a01a580f-aaaa-4b8a-a988-c05a9058a2f6" acquired by "delete_volume" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:43:21 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ba93d7-e8b2-49b1-b968-505c246ad198]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:43:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-71814fdc-e3f6-4f4c-ab1a-338559ab1f54 tempest-VolumesTransfersV357Test-647211288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a01a580f-aaaa-4b8a-a988-c05a9058a2f6 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:21 devstack sudo[89282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a01a580f-aaaa-4b8a-a988-c05a9058a2f6 Apr 02 12:43:21 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:22 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-71814fdc-e3f6-4f4c-ab1a-338559ab1f54 tempest-VolumesTransfersV357Test-647211288 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a01a580f-aaaa-4b8a-a988-c05a9058a2f6" returned: 0 in 0.444s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-71814fdc-e3f6-4f4c-ab1a-338559ab1f54 tempest-VolumesTransfersV357Test-647211288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a01a580f-aaaa-4b8a-a988-c05a9058a2f6 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:22 devstack sudo[89287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a01a580f-aaaa-4b8a-a988-c05a9058a2f6 Apr 02 12:43:22 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:22 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-71814fdc-e3f6-4f4c-ab1a-338559ab1f54 tempest-VolumesTransfersV357Test-647211288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a01a580f-aaaa-4b8a-a988-c05a9058a2f6" returned: 0 in 0.388s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:22 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-71814fdc-e3f6-4f4c-ab1a-338559ab1f54 tempest-VolumesTransfersV357Test-647211288 None] Lock "cinder-quobyte-a01a580f-aaaa-4b8a-a988-c05a9058a2f6" released by "delete_volume" :: held 0.856s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:43:22 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-71814fdc-e3f6-4f4c-ab1a-338559ab1f54 tempest-VolumesTransfersV357Test-647211288 None] Created reservations ['36fd66f6-d492-43d6-ab0f-094a96df76f0', '5c3d9c81-d935-4970-8d39-35e834cd7481', '83dc15ee-a6bd-4f5c-926a-d6f074d2222c', '396e9604-3a96-4270-83d7-0b0698c33c61'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:43:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-71814fdc-e3f6-4f4c-ab1a-338559ab1f54 tempest-VolumesTransfersV357Test-647211288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:43:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-71814fdc-e3f6-4f4c-ab1a-338559ab1f54 tempest-VolumesTransfersV357Test-647211288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:43:22 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-71814fdc-e3f6-4f4c-ab1a-338559ab1f54 tempest-VolumesTransfersV357Test-647211288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:43:22 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-71814fdc-e3f6-4f4c-ab1a-338559ab1f54 tempest-VolumesTransfersV357Test-647211288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:43:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-71814fdc-e3f6-4f4c-ab1a-338559ab1f54 tempest-VolumesTransfersV357Test-647211288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:43:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-71814fdc-e3f6-4f4c-ab1a-338559ab1f54 tempest-VolumesTransfersV357Test-647211288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:22 devstack sudo[89290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:43:22 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:23 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-71814fdc-e3f6-4f4c-ab1a-338559ab1f54 tempest-VolumesTransfersV357Test-647211288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.450s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:23 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-71814fdc-e3f6-4f4c-ab1a-338559ab1f54 tempest-VolumesTransfersV357Test-647211288 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:43:23 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-71814fdc-e3f6-4f4c-ab1a-338559ab1f54 tempest-VolumesTransfersV357Test-647211288 None] Deleted volume successfully. Apr 02 12:43:23 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-71814fdc-e3f6-4f4c-ab1a-338559ab1f54 tempest-VolumesTransfersV357Test-647211288 None] Lock "cinder-a01a580f-aaaa-4b8a-a988-c05a9058a2f6-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:43:30 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:43:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Flow 'volume_create_manager' (4cecdbd7-f3f1-449a-a01f-4865c91d4a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:43:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f9c5e9b-64c2-456d-b9e7-05fe16501b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f9c5e9b-64c2-456d-b9e7-05fe16501b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-201759345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc58620d-841a-4bca-a623-c6bfbc982523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad6ec097fda4dfe9222c0d090eabc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:43:31Z,use_quota=True,user_id='1dd6fcfad6334e6d8f133c345fbea366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e6d32e-143d-4793-bb97-74690367e46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e6d32e-143d-4793-bb97-74690367e46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5189167-074c-4257-96d3-f42c8b40e059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5189167-074c-4257-96d3-f42c8b40e059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc58620d-841a-4bca-a623-c6bfbc982523', 'volume_name': 'volume-fc58620d-841a-4bca-a623-c6bfbc982523', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974e1e4e-4132-4e06-b88f-d1904e06ff83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974e1e4e-4132-4e06-b88f-d1904e06ff83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:30 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee42088-c52b-4d8a-86fa-cd4cbd262ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:30 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Volume fc58620d-841a-4bca-a623-c6bfbc982523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc58620d-841a-4bca-a623-c6bfbc982523', 'volume_size': 1} Apr 02 12:43:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:43:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:43:31 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-201759345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc58620d-841a-4bca-a623-c6bfbc982523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad6ec097fda4dfe9222c0d090eabc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:43:31Z,use_quota=True,user_id='1dd6fcfad6334e6d8f133c345fbea366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:43:31 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Creating volume fc58620d-841a-4bca-a623-c6bfbc982523 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:43:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:43:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:43:31 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:43:31 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:43:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:43:31 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:43:31 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:43:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:31 devstack sudo[89294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523 1073741824 Apr 02 12:43:31 devstack sudo[89294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:31 devstack sudo[89294]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523 1073741824" returned: 0 in 0.451s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:43:31 devstack sudo[89299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523 Apr 02 12:43:31 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:43:31 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root Apr 02 12:43:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523" returned: 0 in 0.392s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:43:31 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:43:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:43:31 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee42088-c52b-4d8a-86fa-cd4cbd262ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc58620d-841a-4bca-a623-c6bfbc982523', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:31 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923e30bb-9dc1-41bd-8ad0-81ae4af8dc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:43:31 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Volume volume-fc58620d-841a-4bca-a623-c6bfbc982523 (fc58620d-841a-4bca-a623-c6bfbc982523): created successfully Apr 02 12:43:31 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923e30bb-9dc1-41bd-8ad0-81ae4af8dc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:43:31 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Flow 'volume_create_manager' (4cecdbd7-f3f1-449a-a01f-4865c91d4a14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:43:31 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-e6b02852-6484-41ca-a37d-b8b0a3f5b7c1 tempest-VolumesActionsTest-1755540893 None] Created volume successfully. Apr 02 12:43:41 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:UPDATE=76,cinder:DELETE=9,cinder:SELECT=44,cinder:INSERT=14 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:43:41 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:UPDATE=63,cinder:SELECT=49,cinder:INSERT=19,cinder:DELETE=3 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:43:45 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-8ff60235-e810-4311-8bde-96c065a168f8 tempest-VolumesActionsTest-1755540893 None] Acquiring lock "cinder-fc58620d-841a-4bca-a623-c6bfbc982523" by "attach_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:43:45 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-8ff60235-e810-4311-8bde-96c065a168f8 tempest-VolumesActionsTest-1755540893 None] Lock "cinder-fc58620d-841a-4bca-a623-c6bfbc982523" acquired by "attach_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:43:45 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-8ff60235-e810-4311-8bde-96c065a168f8 tempest-VolumesActionsTest-1755540893 None] Attaching volume fc58620d-841a-4bca-a623-c6bfbc982523 to instance 06d9c8a6-16d9-42f4-b2f7-9240ce6066d2 at mountpoint /dev/vdb on host None. Apr 02 12:43:45 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-8ff60235-e810-4311-8bde-96c065a168f8 tempest-VolumesActionsTest-1755540893 None] Attach volume completed successfully. Apr 02 12:43:45 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-8ff60235-e810-4311-8bde-96c065a168f8 tempest-VolumesActionsTest-1755540893 None] Lock "cinder-fc58620d-841a-4bca-a623-c6bfbc982523" released by "attach_volume" :: held 0.051s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:43:45 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7eeda947-6b0f-494a-9bbc-524e87f240bf tempest-VolumesActionsTest-1755540893 None] Acquiring lock "cinder-fc58620d-841a-4bca-a623-c6bfbc982523-detach_volume" by "detach_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:43:45 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7eeda947-6b0f-494a-9bbc-524e87f240bf tempest-VolumesActionsTest-1755540893 None] Lock "cinder-fc58620d-841a-4bca-a623-c6bfbc982523-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:43:45 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-7eeda947-6b0f-494a-9bbc-524e87f240bf tempest-VolumesActionsTest-1755540893 None] Detaching volume fc58620d-841a-4bca-a623-c6bfbc982523 from instance 06d9c8a6-16d9-42f4-b2f7-9240ce6066d2. Apr 02 12:43:45 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-7eeda947-6b0f-494a-9bbc-524e87f240bf tempest-VolumesActionsTest-1755540893 None] Detach volume completed successfully. Apr 02 12:43:45 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7eeda947-6b0f-494a-9bbc-524e87f240bf tempest-VolumesActionsTest-1755540893 None] Lock "cinder-fc58620d-841a-4bca-a623-c6bfbc982523-detach_volume" released by "detach_volume" :: held 0.033s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:43:55 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:SELECT=7,cinder:INSERT=1 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:43:55 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:INSERT=1,cinder:SELECT=6,cinder:UPDATE=6 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:44:05 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1b51582e-9ef8-4b23-bd46-ed8da477262f tempest-VolumesActionsTest-1755540893 None] Acquiring lock "cinder-fc58620d-841a-4bca-a623-c6bfbc982523" by "attach_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:44:05 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1b51582e-9ef8-4b23-bd46-ed8da477262f tempest-VolumesActionsTest-1755540893 None] Lock "cinder-fc58620d-841a-4bca-a623-c6bfbc982523" acquired by "attach_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:44:05 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-1b51582e-9ef8-4b23-bd46-ed8da477262f tempest-VolumesActionsTest-1755540893 None] Attaching volume fc58620d-841a-4bca-a623-c6bfbc982523 to instance 1af161a7-c8b3-4328-ae32-0ddf68d06617 at mountpoint /dev/vdb on host None. Apr 02 12:44:05 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-1b51582e-9ef8-4b23-bd46-ed8da477262f tempest-VolumesActionsTest-1755540893 None] Attach volume completed successfully. Apr 02 12:44:05 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1b51582e-9ef8-4b23-bd46-ed8da477262f tempest-VolumesActionsTest-1755540893 None] Lock "cinder-fc58620d-841a-4bca-a623-c6bfbc982523" released by "attach_volume" :: held 0.052s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:44:06 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-26a501f0-edd8-438f-bd5a-57926ff63b4f tempest-VolumesActionsTest-1755540893 None] Acquiring lock "cinder-fc58620d-841a-4bca-a623-c6bfbc982523-detach_volume" by "detach_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:44:06 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-26a501f0-edd8-438f-bd5a-57926ff63b4f tempest-VolumesActionsTest-1755540893 None] Lock "cinder-fc58620d-841a-4bca-a623-c6bfbc982523-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:44:06 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-26a501f0-edd8-438f-bd5a-57926ff63b4f tempest-VolumesActionsTest-1755540893 None] Detaching volume fc58620d-841a-4bca-a623-c6bfbc982523 from instance 1af161a7-c8b3-4328-ae32-0ddf68d06617. Apr 02 12:44:06 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-26a501f0-edd8-438f-bd5a-57926ff63b4f tempest-VolumesActionsTest-1755540893 None] Detach volume completed successfully. Apr 02 12:44:06 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-26a501f0-edd8-438f-bd5a-57926ff63b4f tempest-VolumesActionsTest-1755540893 None] Lock "cinder-fc58620d-841a-4bca-a623-c6bfbc982523-detach_volume" released by "detach_volume" :: held 0.031s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:44:13 devstack cinder-volume[82819]: DEBUG oslo_service.periodic_task [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82819) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 12:44:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:44:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:44:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:44:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:44:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:44:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:13 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:44:13 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:13 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.420s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:13 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:44:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-f91250a0-2daa-4d80-b204-c6a7e54dea78 tempest-VolumesActionsTest-1755540893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:44:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-f91250a0-2daa-4d80-b204-c6a7e54dea78 tempest-VolumesActionsTest-1755540893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:44:13 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0744d0-d5ce-46a1-97fc-928aa54c010a]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:44:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f91250a0-2daa-4d80-b204-c6a7e54dea78 tempest-VolumesActionsTest-1755540893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:13 devstack sudo[89521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523 Apr 02 12:44:13 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:14 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f91250a0-2daa-4d80-b204-c6a7e54dea78 tempest-VolumesActionsTest-1755540893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523" returned: 0 in 0.422s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:14 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b8aef1-6b32-4c6f-8037-4b55e1591e16]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:44:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f91250a0-2daa-4d80-b204-c6a7e54dea78 tempest-VolumesActionsTest-1755540893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:14 devstack sudo[89526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523 Apr 02 12:44:14 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:14 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f91250a0-2daa-4d80-b204-c6a7e54dea78 tempest-VolumesActionsTest-1755540893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523" returned: 0 in 0.426s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f91250a0-2daa-4d80-b204-c6a7e54dea78 tempest-VolumesActionsTest-1755540893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523 /opt/stack/data/cinder/conversion/fc58620d-841a-4bca-a623-c6bfbc982523.temp_image.5ccdbd7d-0cb0-4350-abd6-2380ea34f535xe8ni6ok.img {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:14 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523 /opt/stack/data/cinder/conversion/fc58620d-841a-4bca-a623-c6bfbc982523.temp_image.5ccdbd7d-0cb0-4350-abd6-2380ea34f535xe8ni6ok.img Apr 02 12:44:14 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:16 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f91250a0-2daa-4d80-b204-c6a7e54dea78 tempest-VolumesActionsTest-1755540893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523 /opt/stack/data/cinder/conversion/fc58620d-841a-4bca-a623-c6bfbc982523.temp_image.5ccdbd7d-0cb0-4350-abd6-2380ea34f535xe8ni6ok.img" returned: 0 in 1.651s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:16 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f998f9c6-8d8a-4082-b1f1-3a25a876d448]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:44:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f91250a0-2daa-4d80-b204-c6a7e54dea78 tempest-VolumesActionsTest-1755540893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:16 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:UPDATE=3,cinder:INSERT=1,cinder:SELECT=6 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:44:16 devstack sudo[89543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523 Apr 02 12:44:16 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:16 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f91250a0-2daa-4d80-b204-c6a7e54dea78 tempest-VolumesActionsTest-1755540893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523" returned: 0 in 0.534s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:16 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-f91250a0-2daa-4d80-b204-c6a7e54dea78 tempest-VolumesActionsTest-1755540893 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523, size 1024.00 MB, duration 1.65 sec, destination /opt/stack/data/cinder/conversion/fc58620d-841a-4bca-a623-c6bfbc982523.temp_image.5ccdbd7d-0cb0-4350-abd6-2380ea34f535xe8ni6ok.img {{(pid=82819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 12:44:16 devstack cinder-volume[82819]: INFO cinder.image.image_utils [None req-f91250a0-2daa-4d80-b204-c6a7e54dea78 tempest-VolumesActionsTest-1755540893 None] Converted 1024.00 MB image at 619.80 MB/s Apr 02 12:44:16 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-f91250a0-2daa-4d80-b204-c6a7e54dea78 tempest-VolumesActionsTest-1755540893 None] 5ccdbd7d-0cb0-4350-abd6-2380ea34f535 was raw, no need to convert to raw {{(pid=82819) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 02 12:44:23 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=4 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:44:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-f91250a0-2daa-4d80-b204-c6a7e54dea78 tempest-VolumesActionsTest-1755540893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.488s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:44:26 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-f91250a0-2daa-4d80-b204-c6a7e54dea78 tempest-VolumesActionsTest-1755540893 None] Uploaded volume to glance image-id: 5ccdbd7d-0cb0-4350-abd6-2380ea34f535. {{(pid=82819) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 02 12:44:26 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-f91250a0-2daa-4d80-b204-c6a7e54dea78 tempest-VolumesActionsTest-1755540893 None] Copy volume to image completed successfully. Apr 02 12:44:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-73b36d4c-0ddc-4d5b-b554-6844e1fdbcb6 tempest-VolumesActionsTest-1755540893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:44:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-73b36d4c-0ddc-4d5b-b554-6844e1fdbcb6 tempest-VolumesActionsTest-1755540893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:44:27 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b220f19-8df8-49bb-8991-e5046b6a2096]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:44:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-73b36d4c-0ddc-4d5b-b554-6844e1fdbcb6 tempest-VolumesActionsTest-1755540893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:27 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523 Apr 02 12:44:27 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:28 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-73b36d4c-0ddc-4d5b-b554-6844e1fdbcb6 tempest-VolumesActionsTest-1755540893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523" returned: 0 in 0.418s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:28 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[3014c4ef-f2f1-4ce2-9242-bdc6d69b3127]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:44:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-73b36d4c-0ddc-4d5b-b554-6844e1fdbcb6 tempest-VolumesActionsTest-1755540893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:28 devstack sudo[89555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523 Apr 02 12:44:28 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:28 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-73b36d4c-0ddc-4d5b-b554-6844e1fdbcb6 tempest-VolumesActionsTest-1755540893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523" returned: 0 in 0.422s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-73b36d4c-0ddc-4d5b-b554-6844e1fdbcb6 tempest-VolumesActionsTest-1755540893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523 /opt/stack/data/cinder/conversion/fc58620d-841a-4bca-a623-c6bfbc982523.temp_image.10396198-2599-478f-bf29-95b3e18aba453n8bb1e7.img {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:28 devstack sudo[89560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523 /opt/stack/data/cinder/conversion/fc58620d-841a-4bca-a623-c6bfbc982523.temp_image.10396198-2599-478f-bf29-95b3e18aba453n8bb1e7.img Apr 02 12:44:28 devstack sudo[89560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:30 devstack sudo[89560]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-73b36d4c-0ddc-4d5b-b554-6844e1fdbcb6 tempest-VolumesActionsTest-1755540893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523 /opt/stack/data/cinder/conversion/fc58620d-841a-4bca-a623-c6bfbc982523.temp_image.10396198-2599-478f-bf29-95b3e18aba453n8bb1e7.img" returned: 0 in 1.596s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:30 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e708d5-9127-4e57-b312-dea096e7616b]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:44:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-73b36d4c-0ddc-4d5b-b554-6844e1fdbcb6 tempest-VolumesActionsTest-1755540893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:30 devstack sudo[89572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523 Apr 02 12:44:30 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:30 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-73b36d4c-0ddc-4d5b-b554-6844e1fdbcb6 tempest-VolumesActionsTest-1755540893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523" returned: 0 in 0.527s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:30 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-73b36d4c-0ddc-4d5b-b554-6844e1fdbcb6 tempest-VolumesActionsTest-1755540893 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523, size 1024.00 MB, duration 1.60 sec, destination /opt/stack/data/cinder/conversion/fc58620d-841a-4bca-a623-c6bfbc982523.temp_image.10396198-2599-478f-bf29-95b3e18aba453n8bb1e7.img {{(pid=82819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 12:44:30 devstack cinder-volume[82819]: INFO cinder.image.image_utils [None req-73b36d4c-0ddc-4d5b-b554-6844e1fdbcb6 tempest-VolumesActionsTest-1755540893 None] Converted 1024.00 MB image at 641.20 MB/s Apr 02 12:44:30 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-73b36d4c-0ddc-4d5b-b554-6844e1fdbcb6 tempest-VolumesActionsTest-1755540893 None] 10396198-2599-478f-bf29-95b3e18aba45 was raw, converting to qcow2 {{(pid=82819) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 02 12:44:30 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0935caa9-225c-4e4c-99e0-57df65c41f27]: (4, 'raw') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:44:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-73b36d4c-0ddc-4d5b-b554-6844e1fdbcb6 tempest-VolumesActionsTest-1755540893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fc58620d-841a-4bca-a623-c6bfbc982523.temp_image.10396198-2599-478f-bf29-95b3e18aba453n8bb1e7.img {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:30 devstack sudo[89577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fc58620d-841a-4bca-a623-c6bfbc982523.temp_image.10396198-2599-478f-bf29-95b3e18aba453n8bb1e7.img Apr 02 12:44:30 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:31 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-73b36d4c-0ddc-4d5b-b554-6844e1fdbcb6 tempest-VolumesActionsTest-1755540893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fc58620d-841a-4bca-a623-c6bfbc982523.temp_image.10396198-2599-478f-bf29-95b3e18aba453n8bb1e7.img" returned: 0 in 0.411s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-73b36d4c-0ddc-4d5b-b554-6844e1fdbcb6 tempest-VolumesActionsTest-1755540893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fc58620d-841a-4bca-a623-c6bfbc982523.temp_image.10396198-2599-478f-bf29-95b3e18aba453n8bb1e7.img {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:31 devstack sudo[89581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fc58620d-841a-4bca-a623-c6bfbc982523.temp_image.10396198-2599-478f-bf29-95b3e18aba453n8bb1e7.img Apr 02 12:44:31 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:31 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-73b36d4c-0ddc-4d5b-b554-6844e1fdbcb6 tempest-VolumesActionsTest-1755540893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fc58620d-841a-4bca-a623-c6bfbc982523.temp_image.10396198-2599-478f-bf29-95b3e18aba453n8bb1e7.img" returned: 1 in 0.442s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-73b36d4c-0ddc-4d5b-b554-6844e1fdbcb6 tempest-VolumesActionsTest-1755540893 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fc58620d-841a-4bca-a623-c6bfbc982523.temp_image.10396198-2599-478f-bf29-95b3e18aba453n8bb1e7.img' failed. Not Retrying. {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 12:44:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-73b36d4c-0ddc-4d5b-b554-6844e1fdbcb6 tempest-VolumesActionsTest-1755540893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fc58620d-841a-4bca-a623-c6bfbc982523.temp_image.10396198-2599-478f-bf29-95b3e18aba453n8bb1e7.img /opt/stack/data/cinder/conversion/vol_upload_y5lus27u {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:31 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fc58620d-841a-4bca-a623-c6bfbc982523.temp_image.10396198-2599-478f-bf29-95b3e18aba453n8bb1e7.img /opt/stack/data/cinder/conversion/vol_upload_y5lus27u Apr 02 12:44:31 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:32 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-73b36d4c-0ddc-4d5b-b554-6844e1fdbcb6 tempest-VolumesActionsTest-1755540893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fc58620d-841a-4bca-a623-c6bfbc982523.temp_image.10396198-2599-478f-bf29-95b3e18aba453n8bb1e7.img /opt/stack/data/cinder/conversion/vol_upload_y5lus27u" returned: 0 in 0.711s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:32 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-73b36d4c-0ddc-4d5b-b554-6844e1fdbcb6 tempest-VolumesActionsTest-1755540893 None] Image conversion details: src /opt/stack/data/cinder/conversion/fc58620d-841a-4bca-a623-c6bfbc982523.temp_image.10396198-2599-478f-bf29-95b3e18aba453n8bb1e7.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_y5lus27u {{(pid=82819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 12:44:32 devstack cinder-volume[82819]: INFO cinder.image.image_utils [None req-73b36d4c-0ddc-4d5b-b554-6844e1fdbcb6 tempest-VolumesActionsTest-1755540893 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 02 12:44:32 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2390cd6-fc5b-4b35-81a4-6729fd560492]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:44:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-73b36d4c-0ddc-4d5b-b554-6844e1fdbcb6 tempest-VolumesActionsTest-1755540893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_y5lus27u {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:32 devstack sudo[89591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_y5lus27u Apr 02 12:44:32 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:32 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-73b36d4c-0ddc-4d5b-b554-6844e1fdbcb6 tempest-VolumesActionsTest-1755540893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_y5lus27u" returned: 0 in 0.416s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-73b36d4c-0ddc-4d5b-b554-6844e1fdbcb6 tempest-VolumesActionsTest-1755540893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 5.842s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:44:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-73b36d4c-0ddc-4d5b-b554-6844e1fdbcb6 tempest-VolumesActionsTest-1755540893 None] Uploaded volume to glance image-id: 10396198-2599-478f-bf29-95b3e18aba45. {{(pid=82819) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 02 12:44:33 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-73b36d4c-0ddc-4d5b-b554-6844e1fdbcb6 tempest-VolumesActionsTest-1755540893 None] Copy volume to image completed successfully. Apr 02 12:44:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6c49508a-10cf-40c3-8fb6-78ed60348e34 tempest-VolumesActionsTest-1755540893 None] Acquiring lock "cinder-fc58620d-841a-4bca-a623-c6bfbc982523-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:44:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6c49508a-10cf-40c3-8fb6-78ed60348e34 tempest-VolumesActionsTest-1755540893 None] Lock "cinder-fc58620d-841a-4bca-a623-c6bfbc982523-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:44:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6c49508a-10cf-40c3-8fb6-78ed60348e34 tempest-VolumesActionsTest-1755540893 None] Acquiring lock "cinder-quobyte-fc58620d-841a-4bca-a623-c6bfbc982523" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:44:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6c49508a-10cf-40c3-8fb6-78ed60348e34 tempest-VolumesActionsTest-1755540893 None] Lock "cinder-quobyte-fc58620d-841a-4bca-a623-c6bfbc982523" acquired by "delete_volume" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:44:34 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c35468-2a32-4747-b675-493982ff5f3f]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:44:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6c49508a-10cf-40c3-8fb6-78ed60348e34 tempest-VolumesActionsTest-1755540893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:34 devstack sudo[89596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523 Apr 02 12:44:34 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:34 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6c49508a-10cf-40c3-8fb6-78ed60348e34 tempest-VolumesActionsTest-1755540893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523" returned: 0 in 0.429s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6c49508a-10cf-40c3-8fb6-78ed60348e34 tempest-VolumesActionsTest-1755540893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:34 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523 Apr 02 12:44:34 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:35 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6c49508a-10cf-40c3-8fb6-78ed60348e34 tempest-VolumesActionsTest-1755540893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-fc58620d-841a-4bca-a623-c6bfbc982523" returned: 0 in 0.363s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:35 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6c49508a-10cf-40c3-8fb6-78ed60348e34 tempest-VolumesActionsTest-1755540893 None] Lock "cinder-quobyte-fc58620d-841a-4bca-a623-c6bfbc982523" released by "delete_volume" :: held 0.818s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:44:35 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-6c49508a-10cf-40c3-8fb6-78ed60348e34 tempest-VolumesActionsTest-1755540893 None] Created reservations ['7a91a96e-b118-4cc1-b1ff-3b1b4af561e8', '8428f4e8-34a8-4803-adcf-47f7d93dbeae', 'd981d426-91e9-4f0f-b9fd-2629e670156a', 'a2e7025c-e5e1-42d6-b17d-119e4645aa6a'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:44:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6c49508a-10cf-40c3-8fb6-78ed60348e34 tempest-VolumesActionsTest-1755540893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:44:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6c49508a-10cf-40c3-8fb6-78ed60348e34 tempest-VolumesActionsTest-1755540893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:44:35 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6c49508a-10cf-40c3-8fb6-78ed60348e34 tempest-VolumesActionsTest-1755540893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:44:35 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6c49508a-10cf-40c3-8fb6-78ed60348e34 tempest-VolumesActionsTest-1755540893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:44:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6c49508a-10cf-40c3-8fb6-78ed60348e34 tempest-VolumesActionsTest-1755540893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:44:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6c49508a-10cf-40c3-8fb6-78ed60348e34 tempest-VolumesActionsTest-1755540893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:35 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:44:35 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:35 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6c49508a-10cf-40c3-8fb6-78ed60348e34 tempest-VolumesActionsTest-1755540893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.374s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:35 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-6c49508a-10cf-40c3-8fb6-78ed60348e34 tempest-VolumesActionsTest-1755540893 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:44:35 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-6c49508a-10cf-40c3-8fb6-78ed60348e34 tempest-VolumesActionsTest-1755540893 None] Deleted volume successfully. Apr 02 12:44:35 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6c49508a-10cf-40c3-8fb6-78ed60348e34 tempest-VolumesActionsTest-1755540893 None] Lock "cinder-fc58620d-841a-4bca-a623-c6bfbc982523-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:44:39 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:44:39 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Flow 'volume_create_manager' (1bc7d554-9ae3-44c4-a310-b06db0508580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:44:39 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d3162ed-2393-43d0-bf1d-b6eff9fcf55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:44:39 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d3162ed-2393-43d0-bf1d-b6eff9fcf55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1072677603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=074cc4ac-b956-4d8b-85ef-bcb7ef8336b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e234ee13f1c4dc6a85deff2dba10296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:44:39Z,use_quota=True,user_id='ac5af92ff5b14d1d9457c4d227535a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:44:39 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b333c5-29cf-419a-944b-455810c69e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:44:39 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b333c5-29cf-419a-944b-455810c69e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:44:39 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13fac196-45bc-4cb0-bb06-4c7a5e10afed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:44:39 devstack cinder-volume[82819]: DEBUG cinder.image.glance [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Creating Keystone auth plugin from conf {{(pid=82819) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 02 12:44:39 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13fac196-45bc-4cb0-bb06-4c7a5e10afed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '074cc4ac-b956-4d8b-85ef-bcb7ef8336b8', 'volume_name': 'volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8', 'volume_size': 1, 'image_id': '361107cd-f0bc-4798-a524-aa6f2b337172', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/361107cd-f0bc-4798-a524-aa6f2b337172', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd668ace29fed46e98c54f346600c750f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '361107cd-f0bc-4798-a524-aa6f2b337172', 'created_at': datetime.datetime(2026, 4, 2, 10, 29, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 10, 29, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/361107cd-f0bc-4798-a524-aa6f2b337172/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:44:39 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d4dad3-8a24-4075-9d7b-c33e58060638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:44:39 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d4dad3-8a24-4075-9d7b-c33e58060638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:44:39 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a952ad0-ec61-4f3c-97e0-35be570ea91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:44:39 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Volume 074cc4ac-b956-4d8b-85ef-bcb7ef8336b8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8', 'volume_size': 1, 'image_id': '361107cd-f0bc-4798-a524-aa6f2b337172', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/361107cd-f0bc-4798-a524-aa6f2b337172', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd668ace29fed46e98c54f346600c750f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '361107cd-f0bc-4798-a524-aa6f2b337172', 'created_at': datetime.datetime(2026, 4, 2, 10, 29, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 10, 29, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/361107cd-f0bc-4798-a524-aa6f2b337172/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 02 12:44:39 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Trying to clone 074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 from image 361107cd-f0bc-4798-a524-aa6f2b337172 at location (None, [{'url': 'file:///opt/stack/data/glance/images/361107cd-f0bc-4798-a524-aa6f2b337172', 'metadata': {}}]). {{(pid=82819) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 02 12:44:39 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_lbocud6tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82819) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 02 12:44:39 devstack cinder-volume[82819]: INFO cinder.image.image_utils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Image download 20.69 MB at 20.69 MB/s Apr 02 12:44:39 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa65ab9-aea7-41e1-96d0-832004464d2a]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:44:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_lbocud6tdevstack@QuobyteHD {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:39 devstack sudo[89612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_lbocud6tdevstack@QuobyteHD Apr 02 12:44:39 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:39 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_lbocud6tdevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:39 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Temporary image 361107cd-f0bc-4798-a524-aa6f2b337172 is fetched for user ac5af92ff5b14d1d9457c4d227535a42. {{(pid=82819) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 02 12:44:40 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02f2b37-346e-4416-855e-2fc82881d0f1]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:44:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_lbocud6tdevstack@QuobyteHD {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:40 devstack sudo[89617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_lbocud6tdevstack@QuobyteHD Apr 02 12:44:40 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:40 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_lbocud6tdevstack@QuobyteHD" returned: 0 in 0.433s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:44:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:44:40 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1072677603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=074cc4ac-b956-4d8b-85ef-bcb7ef8336b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e234ee13f1c4dc6a85deff2dba10296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:44:39Z,use_quota=True,user_id='ac5af92ff5b14d1d9457c4d227535a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:44:40 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Creating volume 074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:44:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:44:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:44:40 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:44:40 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:44:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:44:40 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:44:40 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:44:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:40 devstack sudo[89622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 1073741824 Apr 02 12:44:40 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:40 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 1073741824" returned: 0 in 0.449s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:40 devstack sudo[89627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 Apr 02 12:44:40 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:41 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8" returned: 0 in 0.403s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:41 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:44:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:44:41 devstack cinder-volume[82819]: DEBUG cinder.volume.volume_utils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Attempting download of 361107cd-f0bc-4798-a524-aa6f2b337172 ((None, [{'url': 'file:///opt/stack/data/glance/images/361107cd-f0bc-4798-a524-aa6f2b337172', 'metadata': {}}])) to volume 074cc4ac-b956-4d8b-85ef-bcb7ef8336b8. {{(pid=82819) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 02 12:44:41 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e600752-ecae-4b82-9709-034c6d5e6f2c]: (4, 'raw') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:44:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_361107cd-f0bc-4798-a524-aa6f2b337172_69xkm087 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:41 devstack sudo[89630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_361107cd-f0bc-4798-a524-aa6f2b337172_69xkm087 Apr 02 12:44:41 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:41 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_361107cd-f0bc-4798-a524-aa6f2b337172_69xkm087" returned: 0 in 0.466s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_361107cd-f0bc-4798-a524-aa6f2b337172_69xkm087 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:41 devstack sudo[89640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_361107cd-f0bc-4798-a524-aa6f2b337172_69xkm087 Apr 02 12:44:41 devstack sudo[89640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:42 devstack sudo[89640]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_361107cd-f0bc-4798-a524-aa6f2b337172_69xkm087" returned: 1 in 0.419s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_361107cd-f0bc-4798-a524-aa6f2b337172_69xkm087' failed. Not Retrying. {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 12:44:42 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d2217f-b209-410b-8edd-76d423cff00f]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:44:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_lbocud6tdevstack@QuobyteHD {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:42 devstack sudo[89644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_lbocud6tdevstack@QuobyteHD Apr 02 12:44:42 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:42 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_lbocud6tdevstack@QuobyteHD" returned: 0 in 0.471s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:42 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] 361107cd-f0bc-4798-a524-aa6f2b337172 was qcow2, converting to raw {{(pid=82819) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 02 12:44:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_lbocud6tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:42 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_lbocud6tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 Apr 02 12:44:42 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:43 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_lbocud6tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8" returned: 0 in 0.789s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:43 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_lbocud6tdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 {{(pid=82819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 12:44:43 devstack cinder-volume[82819]: INFO cinder.image.image_utils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Converted 112.00 MB image at 112.00 MB/s Apr 02 12:44:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:43 devstack sudo[89661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 1G Apr 02 12:44:43 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:43 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 1G" returned: 0 in 0.386s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:43 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cb13bc-17a8-41e1-9587-2995da9a19a2]: (4, 'raw') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:44:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:44 devstack sudo[89666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 Apr 02 12:44:44 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:44 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8" returned: 0 in 0.412s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:44 devstack sudo[89670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 Apr 02 12:44:44 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:44 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8" returned: 1 in 0.412s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8' failed. Not Retrying. {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 12:44:44 devstack cinder-volume[82819]: DEBUG cinder.volume.volume_utils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Downloaded image 361107cd-f0bc-4798-a524-aa6f2b337172 ((None, [{'url': 'file:///opt/stack/data/glance/images/361107cd-f0bc-4798-a524-aa6f2b337172', 'metadata': {}}])) to volume 074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 successfully. {{(pid=82819) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 02 12:44:44 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Temporary image 361107cd-f0bc-4798-a524-aa6f2b337172 for user ac5af92ff5b14d1d9457c4d227535a42 is deleted. {{(pid=82819) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 02 12:44:44 devstack cinder-volume[82819]: DEBUG cinder.volume.volume_utils [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Marking volume 074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 as bootable. {{(pid=82819) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 02 12:44:44 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Copying metadata from image 361107cd-f0bc-4798-a524-aa6f2b337172 to 074cc4ac-b956-4d8b-85ef-bcb7ef8336b8. {{(pid=82819) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 02 12:44:44 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Creating volume glance metadata for volume 074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 backed by image 361107cd-f0bc-4798-a524-aa6f2b337172 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '361107cd-f0bc-4798-a524-aa6f2b337172', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82819) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 02 12:44:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a952ad0-ec61-4f3c-97e0-35be570ea91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8', 'volume_size': 1, 'image_id': '361107cd-f0bc-4798-a524-aa6f2b337172', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/361107cd-f0bc-4798-a524-aa6f2b337172', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd668ace29fed46e98c54f346600c750f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '361107cd-f0bc-4798-a524-aa6f2b337172', 'created_at': datetime.datetime(2026, 4, 2, 10, 29, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 10, 29, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/361107cd-f0bc-4798-a524-aa6f2b337172/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:44:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adca6d19-a7ba-4c52-aea1-47f44c9ab2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:44:44 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Volume volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 (074cc4ac-b956-4d8b-85ef-bcb7ef8336b8): created successfully Apr 02 12:44:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adca6d19-a7ba-4c52-aea1-47f44c9ab2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:44:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Flow 'volume_create_manager' (1bc7d554-9ae3-44c4-a310-b06db0508580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:44:44 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-9bdb3ce5-8ebd-474f-8e4c-2b8aac3ddb4a tempest-VolumesExtendTest-364253703 None] Created volume successfully. Apr 02 12:44:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-81254bce-80b5-4e10-ba8b-49e6a9b4f0d1 tempest-VolumesExtendTest-364253703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:44:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-81254bce-80b5-4e10-ba8b-49e6a9b4f0d1 tempest-VolumesExtendTest-364253703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:44:45 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[008d57d5-531f-4931-b94c-38417e442b69]: (4, 'raw') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:44:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-81254bce-80b5-4e10-ba8b-49e6a9b4f0d1 tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:45 devstack sudo[89675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 Apr 02 12:44:45 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:45 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-81254bce-80b5-4e10-ba8b-49e6a9b4f0d1 tempest-VolumesExtendTest-364253703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8" returned: 0 in 0.418s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-81254bce-80b5-4e10-ba8b-49e6a9b4f0d1 tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:46 devstack sudo[89679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 Apr 02 12:44:46 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:46 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-81254bce-80b5-4e10-ba8b-49e6a9b4f0d1 tempest-VolumesExtendTest-364253703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8" returned: 1 in 0.415s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-81254bce-80b5-4e10-ba8b-49e6a9b4f0d1 tempest-VolumesExtendTest-364253703 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8' failed. Not Retrying. {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 12:44:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-81254bce-80b5-4e10-ba8b-49e6a9b4f0d1 tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 2G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-81254bce-80b5-4e10-ba8b-49e6a9b4f0d1 tempest-VolumesExtendTest-364253703 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 2G" returned: 0 in 0.040s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-81254bce-80b5-4e10-ba8b-49e6a9b4f0d1 tempest-VolumesExtendTest-364253703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.900s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:44:46 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-81254bce-80b5-4e10-ba8b-49e6a9b4f0d1 tempest-VolumesExtendTest-364253703 None] Extend volume completed successfully. Apr 02 12:44:46 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-9f0838a7-79d7-42c4-b050-d7d3b0d999a3 tempest-VolumesExtendTest-364253703 None] Acquiring lock "cinder-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:44:46 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-9f0838a7-79d7-42c4-b050-d7d3b0d999a3 tempest-VolumesExtendTest-364253703 None] Lock "cinder-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:44:46 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-9f0838a7-79d7-42c4-b050-d7d3b0d999a3 tempest-VolumesExtendTest-364253703 None] Acquiring lock "cinder-quobyte-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:44:46 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-9f0838a7-79d7-42c4-b050-d7d3b0d999a3 tempest-VolumesExtendTest-364253703 None] Lock "cinder-quobyte-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8" acquired by "delete_volume" :: waited 0.007s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:44:46 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e7e8da-0595-40d6-a577-3de9beab3a3b]: (4, 'raw') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:44:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9f0838a7-79d7-42c4-b050-d7d3b0d999a3 tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:46 devstack sudo[89687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 Apr 02 12:44:46 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:47 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9f0838a7-79d7-42c4-b050-d7d3b0d999a3 tempest-VolumesExtendTest-364253703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8" returned: 0 in 0.409s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9f0838a7-79d7-42c4-b050-d7d3b0d999a3 tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:47 devstack sudo[89691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 Apr 02 12:44:47 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:47 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9f0838a7-79d7-42c4-b050-d7d3b0d999a3 tempest-VolumesExtendTest-364253703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8" returned: 1 in 0.419s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9f0838a7-79d7-42c4-b050-d7d3b0d999a3 tempest-VolumesExtendTest-364253703 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8' failed. Not Retrying. {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 12:44:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9f0838a7-79d7-42c4-b050-d7d3b0d999a3 tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:47 devstack sudo[89697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8 Apr 02 12:44:47 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:48 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9f0838a7-79d7-42c4-b050-d7d3b0d999a3 tempest-VolumesExtendTest-364253703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8" returned: 0 in 0.361s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:48 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-9f0838a7-79d7-42c4-b050-d7d3b0d999a3 tempest-VolumesExtendTest-364253703 None] Lock "cinder-quobyte-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8" released by "delete_volume" :: held 1.230s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:44:48 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-9f0838a7-79d7-42c4-b050-d7d3b0d999a3 tempest-VolumesExtendTest-364253703 None] Created reservations ['c0ce2ea1-348a-4c4e-9f29-71ade55d2a78', '2d044b1b-367a-45ae-9d42-d2473b0076c3', 'c75e8762-16f9-48b8-ac46-84e8278c36f7', 'edcc046f-998e-43f6-a2df-6efe4a2a55e3'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:44:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9f0838a7-79d7-42c4-b050-d7d3b0d999a3 tempest-VolumesExtendTest-364253703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:44:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9f0838a7-79d7-42c4-b050-d7d3b0d999a3 tempest-VolumesExtendTest-364253703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:44:48 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9f0838a7-79d7-42c4-b050-d7d3b0d999a3 tempest-VolumesExtendTest-364253703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:44:48 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9f0838a7-79d7-42c4-b050-d7d3b0d999a3 tempest-VolumesExtendTest-364253703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:44:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9f0838a7-79d7-42c4-b050-d7d3b0d999a3 tempest-VolumesExtendTest-364253703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:44:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9f0838a7-79d7-42c4-b050-d7d3b0d999a3 tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:48 devstack sudo[89700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:44:48 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:48 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9f0838a7-79d7-42c4-b050-d7d3b0d999a3 tempest-VolumesExtendTest-364253703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.363s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:48 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-9f0838a7-79d7-42c4-b050-d7d3b0d999a3 tempest-VolumesExtendTest-364253703 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:44:48 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-9f0838a7-79d7-42c4-b050-d7d3b0d999a3 tempest-VolumesExtendTest-364253703 None] Deleted volume successfully. Apr 02 12:44:48 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-9f0838a7-79d7-42c4-b050-d7d3b0d999a3 tempest-VolumesExtendTest-364253703 None] Lock "cinder-074cc4ac-b956-4d8b-85ef-bcb7ef8336b8-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:44:49 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:44:49 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Flow 'volume_create_manager' (48a6b958-1d99-4888-a9a2-f488b5f26fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:44:49 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c31f69-834c-4be8-809d-09136253cc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:44:49 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c31f69-834c-4be8-809d-09136253cc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1217486295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cce61eb3-9120-4940-ba3b-177778406eaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e234ee13f1c4dc6a85deff2dba10296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:44:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:44:49Z,use_quota=True,user_id='ac5af92ff5b14d1d9457c4d227535a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:44:49 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c0d204-211b-4e27-a3cf-de3fb6ed09f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:44:49 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c0d204-211b-4e27-a3cf-de3fb6ed09f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:44:49 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (955e7b42-ddfd-4304-85be-cfee6648a657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:44:49 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (955e7b42-ddfd-4304-85be-cfee6648a657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cce61eb3-9120-4940-ba3b-177778406eaa', 'volume_name': 'volume-cce61eb3-9120-4940-ba3b-177778406eaa', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:44:49 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66e0487d-bce0-4b9f-8ec9-7bb2b4efb0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:44:49 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66e0487d-bce0-4b9f-8ec9-7bb2b4efb0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:44:49 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba8b20b-39b8-4e05-b97b-6880712ac3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:44:49 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Volume cce61eb3-9120-4940-ba3b-177778406eaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cce61eb3-9120-4940-ba3b-177778406eaa', 'volume_size': 1} Apr 02 12:44:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:44:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:44:49 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1217486295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cce61eb3-9120-4940-ba3b-177778406eaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e234ee13f1c4dc6a85deff2dba10296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:44:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:44:49Z,use_quota=True,user_id='ac5af92ff5b14d1d9457c4d227535a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:44:49 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Creating volume cce61eb3-9120-4940-ba3b-177778406eaa {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:44:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:44:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:44:49 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:44:49 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:44:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:44:49 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:44:49 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:44:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:49 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa 1073741824 Apr 02 12:44:49 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:49 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa 1073741824" returned: 0 in 0.429s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:49 devstack sudo[89708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa Apr 02 12:44:49 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:49 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa" returned: 0 in 0.358s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:44:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:44:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba8b20b-39b8-4e05-b97b-6880712ac3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cce61eb3-9120-4940-ba3b-177778406eaa', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:44:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75c845a3-c5c0-4520-bc78-9d7e083c3678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:44:50 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Volume volume-cce61eb3-9120-4940-ba3b-177778406eaa (cce61eb3-9120-4940-ba3b-177778406eaa): created successfully Apr 02 12:44:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75c845a3-c5c0-4520-bc78-9d7e083c3678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:44:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Flow 'volume_create_manager' (48a6b958-1d99-4888-a9a2-f488b5f26fa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:44:50 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-b6973685-5afc-43dc-a0f6-92f28fcdd721 tempest-VolumesExtendTest-364253703 None] Created volume successfully. Apr 02 12:44:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-819f6ca7-a923-4e25-974b-ca9b1c4ceec1 tempest-VolumesExtendTest-364253703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:44:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-819f6ca7-a923-4e25-974b-ca9b1c4ceec1 tempest-VolumesExtendTest-364253703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:44:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-819f6ca7-a923-4e25-974b-ca9b1c4ceec1 tempest-VolumesExtendTest-364253703 None] Creating offline snapshot 87096035-7dd7-4eca-8421-1f330e613f56 of volume cce61eb3-9120-4940-ba3b-177778406eaa {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:44:50 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17d7c2c-980e-464a-acf6-d37e975de506]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:44:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-819f6ca7-a923-4e25-974b-ca9b1c4ceec1 tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:50 devstack sudo[89711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa Apr 02 12:44:50 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:50 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-819f6ca7-a923-4e25-974b-ca9b1c4ceec1 tempest-VolumesExtendTest-364253703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa" returned: 0 in 0.423s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-819f6ca7-a923-4e25-974b-ca9b1c4ceec1 tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa.87096035-7dd7-4eca-8421-1f330e613f56 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:50 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa.87096035-7dd7-4eca-8421-1f330e613f56 1G Apr 02 12:44:50 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:51 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-819f6ca7-a923-4e25-974b-ca9b1c4ceec1 tempest-VolumesExtendTest-364253703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa.87096035-7dd7-4eca-8421-1f330e613f56 1G" returned: 0 in 0.421s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-819f6ca7-a923-4e25-974b-ca9b1c4ceec1 tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cce61eb3-9120-4940-ba3b-177778406eaa -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa.87096035-7dd7-4eca-8421-1f330e613f56 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:51 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cce61eb3-9120-4940-ba3b-177778406eaa -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa.87096035-7dd7-4eca-8421-1f330e613f56 Apr 02 12:44:51 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:51 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-819f6ca7-a923-4e25-974b-ca9b1c4ceec1 tempest-VolumesExtendTest-364253703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cce61eb3-9120-4940-ba3b-177778406eaa -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa.87096035-7dd7-4eca-8421-1f330e613f56" returned: 0 in 0.399s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:51 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-819f6ca7-a923-4e25-974b-ca9b1c4ceec1 tempest-VolumesExtendTest-364253703 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa.87096035-7dd7-4eca-8421-1f330e613f56 is being set with open permissions: ugo+rw Apr 02 12:44:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-819f6ca7-a923-4e25-974b-ca9b1c4ceec1 tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa.87096035-7dd7-4eca-8421-1f330e613f56 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:51 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa.87096035-7dd7-4eca-8421-1f330e613f56 Apr 02 12:44:51 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:51 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-819f6ca7-a923-4e25-974b-ca9b1c4ceec1 tempest-VolumesExtendTest-364253703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa.87096035-7dd7-4eca-8421-1f330e613f56" returned: 0 in 0.365s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-819f6ca7-a923-4e25-974b-ca9b1c4ceec1 tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:51 devstack sudo[89729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa.info Apr 02 12:44:51 devstack sudo[89729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:52 devstack sudo[89729]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-819f6ca7-a923-4e25-974b-ca9b1c4ceec1 tempest-VolumesExtendTest-364253703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa.info" returned: 0 in 0.378s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:52 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-819f6ca7-a923-4e25-974b-ca9b1c4ceec1 tempest-VolumesExtendTest-364253703 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa.info is being set with open permissions: ugo+rw Apr 02 12:44:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-819f6ca7-a923-4e25-974b-ca9b1c4ceec1 tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:52 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa.info Apr 02 12:44:52 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:52 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-819f6ca7-a923-4e25-974b-ca9b1c4ceec1 tempest-VolumesExtendTest-364253703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa.info" returned: 0 in 0.363s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-819f6ca7-a923-4e25-974b-ca9b1c4ceec1 tempest-VolumesExtendTest-364253703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.398s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:44:52 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-819f6ca7-a923-4e25-974b-ca9b1c4ceec1 tempest-VolumesExtendTest-364253703 None] Create snapshot completed successfully Apr 02 12:44:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ee0cbb78-708b-437a-8be7-3370152eb665 tempest-VolumesExtendTest-364253703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:44:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ee0cbb78-708b-437a-8be7-3370152eb665 tempest-VolumesExtendTest-364253703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:44:53 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f32a74-9a03-4a7c-8f93-3e6a65381cb2]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:44:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ee0cbb78-708b-437a-8be7-3370152eb665 tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:53 devstack sudo[89735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa Apr 02 12:44:53 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:53 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ee0cbb78-708b-437a-8be7-3370152eb665 tempest-VolumesExtendTest-364253703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa" returned: 0 in 0.423s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ee0cbb78-708b-437a-8be7-3370152eb665 tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa.87096035-7dd7-4eca-8421-1f330e613f56 2G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ee0cbb78-708b-437a-8be7-3370152eb665 tempest-VolumesExtendTest-364253703 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa.87096035-7dd7-4eca-8421-1f330e613f56 2G" returned: 0 in 0.049s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ee0cbb78-708b-437a-8be7-3370152eb665 tempest-VolumesExtendTest-364253703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.489s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:44:53 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-ee0cbb78-708b-437a-8be7-3370152eb665 tempest-VolumesExtendTest-364253703 None] Extend volume completed successfully. Apr 02 12:44:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d7aeaca6-67a1-47dc-a693-0122c884bd4c tempest-VolumesExtendTest-364253703 None] Acquiring lock "cinder-87096035-7dd7-4eca-8421-1f330e613f56-delete_snapshot" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:44:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d7aeaca6-67a1-47dc-a693-0122c884bd4c tempest-VolumesExtendTest-364253703 None] Lock "cinder-87096035-7dd7-4eca-8421-1f330e613f56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:44:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d7aeaca6-67a1-47dc-a693-0122c884bd4c tempest-VolumesExtendTest-364253703 None] Acquiring lock "cinder-quobyte-cce61eb3-9120-4940-ba3b-177778406eaa" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:44:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d7aeaca6-67a1-47dc-a693-0122c884bd4c tempest-VolumesExtendTest-364253703 None] Lock "cinder-quobyte-cce61eb3-9120-4940-ba3b-177778406eaa" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:44:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d7aeaca6-67a1-47dc-a693-0122c884bd4c tempest-VolumesExtendTest-364253703 None] Acquiring lock "cinder-quobyte-87096035-7dd7-4eca-8421-1f330e613f56" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:44:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d7aeaca6-67a1-47dc-a693-0122c884bd4c tempest-VolumesExtendTest-364253703 None] Lock "cinder-quobyte-87096035-7dd7-4eca-8421-1f330e613f56" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:44:54 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-d7aeaca6-67a1-47dc-a693-0122c884bd4c tempest-VolumesExtendTest-364253703 None] Deleting offline snapshot 87096035-7dd7-4eca-8421-1f330e613f56 of volume cce61eb3-9120-4940-ba3b-177778406eaa {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:44:54 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-d7aeaca6-67a1-47dc-a693-0122c884bd4c tempest-VolumesExtendTest-364253703 None] snapshot_file for this snap is: volume-cce61eb3-9120-4940-ba3b-177778406eaa.87096035-7dd7-4eca-8421-1f330e613f56 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:44:54 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[86974827-2b69-4c2e-9ae4-345d5f9b1e89]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:44:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d7aeaca6-67a1-47dc-a693-0122c884bd4c tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa.87096035-7dd7-4eca-8421-1f330e613f56 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:54 devstack sudo[89743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa.87096035-7dd7-4eca-8421-1f330e613f56 Apr 02 12:44:54 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:55 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d7aeaca6-67a1-47dc-a693-0122c884bd4c tempest-VolumesExtendTest-364253703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa.87096035-7dd7-4eca-8421-1f330e613f56" returned: 0 in 0.423s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:55 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-d7aeaca6-67a1-47dc-a693-0122c884bd4c tempest-VolumesExtendTest-364253703 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cce61eb3-9120-4940-ba3b-177778406eaa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:44:55 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[482b1ea1-8686-4777-90ce-368d8582aaa4]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:44:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d7aeaca6-67a1-47dc-a693-0122c884bd4c tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:55 devstack sudo[89748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa Apr 02 12:44:55 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:55 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d7aeaca6-67a1-47dc-a693-0122c884bd4c tempest-VolumesExtendTest-364253703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa" returned: 0 in 0.422s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d7aeaca6-67a1-47dc-a693-0122c884bd4c tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa.87096035-7dd7-4eca-8421-1f330e613f56 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:55 devstack sudo[89753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa.87096035-7dd7-4eca-8421-1f330e613f56 Apr 02 12:44:55 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:55 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d7aeaca6-67a1-47dc-a693-0122c884bd4c tempest-VolumesExtendTest-364253703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa.87096035-7dd7-4eca-8421-1f330e613f56" returned: 0 in 0.408s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d7aeaca6-67a1-47dc-a693-0122c884bd4c tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa.87096035-7dd7-4eca-8421-1f330e613f56 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:55 devstack sudo[89758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa.87096035-7dd7-4eca-8421-1f330e613f56 Apr 02 12:44:55 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:56 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d7aeaca6-67a1-47dc-a693-0122c884bd4c tempest-VolumesExtendTest-364253703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa.87096035-7dd7-4eca-8421-1f330e613f56" returned: 0 in 0.357s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:56 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d7aeaca6-67a1-47dc-a693-0122c884bd4c tempest-VolumesExtendTest-364253703 None] Lock "cinder-quobyte-87096035-7dd7-4eca-8421-1f330e613f56" released by "_delete_snapshot" :: held 1.659s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:44:56 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d7aeaca6-67a1-47dc-a693-0122c884bd4c tempest-VolumesExtendTest-364253703 None] Lock "cinder-quobyte-cce61eb3-9120-4940-ba3b-177778406eaa" released by "delete_snapshot" :: held 1.668s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:44:56 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-d7aeaca6-67a1-47dc-a693-0122c884bd4c tempest-VolumesExtendTest-364253703 None] Created reservations ['6c6f6dd6-9429-4c99-a750-24bc723c623d', '59c384fb-c845-4a7c-bd97-831ccae0ac1f', '6ea0c9f8-e223-40dc-ba8c-261721b12018', 'fd8685a4-beaa-43ae-89e1-da7cc6524e8a'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:44:56 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-d7aeaca6-67a1-47dc-a693-0122c884bd4c tempest-VolumesExtendTest-364253703 None] Delete snapshot completed successfully. Apr 02 12:44:56 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d7aeaca6-67a1-47dc-a693-0122c884bd4c tempest-VolumesExtendTest-364253703 None] Lock "cinder-87096035-7dd7-4eca-8421-1f330e613f56-delete_snapshot" released by "delete_snapshot" :: held 1.748s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:44:56 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-909bd97d-f12c-44fc-9e2a-d3517db8ce78 tempest-VolumesExtendTest-364253703 None] Acquiring lock "cinder-cce61eb3-9120-4940-ba3b-177778406eaa-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:44:56 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-909bd97d-f12c-44fc-9e2a-d3517db8ce78 tempest-VolumesExtendTest-364253703 None] Lock "cinder-cce61eb3-9120-4940-ba3b-177778406eaa-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:44:56 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-909bd97d-f12c-44fc-9e2a-d3517db8ce78 tempest-VolumesExtendTest-364253703 None] Acquiring lock "cinder-quobyte-cce61eb3-9120-4940-ba3b-177778406eaa" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:44:56 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-909bd97d-f12c-44fc-9e2a-d3517db8ce78 tempest-VolumesExtendTest-364253703 None] Lock "cinder-quobyte-cce61eb3-9120-4940-ba3b-177778406eaa" acquired by "delete_volume" :: waited 0.006s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:44:56 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b1f73e-8d66-4f19-bbde-ef237d516243]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:44:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-909bd97d-f12c-44fc-9e2a-d3517db8ce78 tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:56 devstack sudo[89795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa Apr 02 12:44:56 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:57 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-909bd97d-f12c-44fc-9e2a-d3517db8ce78 tempest-VolumesExtendTest-364253703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa" returned: 0 in 0.425s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-909bd97d-f12c-44fc-9e2a-d3517db8ce78 tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:57 devstack sudo[89800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa Apr 02 12:44:57 devstack sudo[89800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:57 devstack sudo[89800]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-909bd97d-f12c-44fc-9e2a-d3517db8ce78 tempest-VolumesExtendTest-364253703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-cce61eb3-9120-4940-ba3b-177778406eaa" returned: 0 in 0.362s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:57 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-909bd97d-f12c-44fc-9e2a-d3517db8ce78 tempest-VolumesExtendTest-364253703 None] Lock "cinder-quobyte-cce61eb3-9120-4940-ba3b-177778406eaa" released by "delete_volume" :: held 0.818s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:44:57 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-909bd97d-f12c-44fc-9e2a-d3517db8ce78 tempest-VolumesExtendTest-364253703 None] Created reservations ['8acb7b35-041f-4964-9efc-ac1066bf1617', '2e06c8b5-9133-4414-8693-bbc28433468c', 'c506069a-85b4-4496-a439-4c27e67ceaf7', '1a945b0a-f4ed-489b-b3a9-00850bb5fb2b'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:44:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-909bd97d-f12c-44fc-9e2a-d3517db8ce78 tempest-VolumesExtendTest-364253703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:44:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-909bd97d-f12c-44fc-9e2a-d3517db8ce78 tempest-VolumesExtendTest-364253703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:44:57 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-909bd97d-f12c-44fc-9e2a-d3517db8ce78 tempest-VolumesExtendTest-364253703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:44:57 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-909bd97d-f12c-44fc-9e2a-d3517db8ce78 tempest-VolumesExtendTest-364253703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:44:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-909bd97d-f12c-44fc-9e2a-d3517db8ce78 tempest-VolumesExtendTest-364253703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:44:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-909bd97d-f12c-44fc-9e2a-d3517db8ce78 tempest-VolumesExtendTest-364253703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:57 devstack sudo[89804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:44:57 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:58 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-909bd97d-f12c-44fc-9e2a-d3517db8ce78 tempest-VolumesExtendTest-364253703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.407s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:58 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-909bd97d-f12c-44fc-9e2a-d3517db8ce78 tempest-VolumesExtendTest-364253703 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:44:58 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-909bd97d-f12c-44fc-9e2a-d3517db8ce78 tempest-VolumesExtendTest-364253703 None] Deleted volume successfully. Apr 02 12:44:58 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-909bd97d-f12c-44fc-9e2a-d3517db8ce78 tempest-VolumesExtendTest-364253703 None] Lock "cinder-cce61eb3-9120-4940-ba3b-177778406eaa-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:44:59 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:44:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Flow 'volume_create_manager' (aa644fc8-3a3e-4829-b5fe-19feba3184dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:44:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b035a1c-00cd-4d64-944b-61595d74bbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:44:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b035a1c-00cd-4d64-944b-61595d74bbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1062502806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce637708-2e06-4e44-94e0-c3868f88323b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b9c0814326234f9dbe067e5f91604189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:44:59Z,use_quota=True,user_id='ecd0056fc4f04044861284d1cee987bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:44:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4daca00e-9836-4e32-b9d8-5325598d0d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:44:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4daca00e-9836-4e32-b9d8-5325598d0d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:44:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2e25e9-48e3-4407-b673-a73874509cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:44:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2e25e9-48e3-4407-b673-a73874509cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce637708-2e06-4e44-94e0-c3868f88323b', 'volume_name': 'volume-ce637708-2e06-4e44-94e0-c3868f88323b', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:44:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a80fd765-8005-407e-b809-fe449b59675b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:44:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a80fd765-8005-407e-b809-fe449b59675b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:44:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f770af6-40af-4c14-96e5-8c89703592a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:44:59 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Volume ce637708-2e06-4e44-94e0-c3868f88323b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce637708-2e06-4e44-94e0-c3868f88323b', 'volume_size': 1} Apr 02 12:44:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:44:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:44:59 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1062502806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce637708-2e06-4e44-94e0-c3868f88323b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b9c0814326234f9dbe067e5f91604189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:44:59Z,use_quota=True,user_id='ecd0056fc4f04044861284d1cee987bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:44:59 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Creating volume ce637708-2e06-4e44-94e0-c3868f88323b {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:44:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:44:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:44:59 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:44:59 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:44:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:44:59 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:44:59 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:44:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ce637708-2e06-4e44-94e0-c3868f88323b 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:59 devstack sudo[89807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ce637708-2e06-4e44-94e0-c3868f88323b 1073741824 Apr 02 12:44:59 devstack sudo[89807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:44:59 devstack sudo[89807]: pam_unix(sudo:session): session closed for user root Apr 02 12:44:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ce637708-2e06-4e44-94e0-c3868f88323b 1073741824" returned: 0 in 0.427s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:44:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ce637708-2e06-4e44-94e0-c3868f88323b {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:44:59 devstack sudo[89812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ce637708-2e06-4e44-94e0-c3868f88323b Apr 02 12:44:59 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:00 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ce637708-2e06-4e44-94e0-c3868f88323b" returned: 0 in 0.361s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f770af6-40af-4c14-96e5-8c89703592a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce637708-2e06-4e44-94e0-c3868f88323b', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df275dd-1e3c-4a86-8fe1-2e2b7dd9e933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:00 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Volume volume-ce637708-2e06-4e44-94e0-c3868f88323b (ce637708-2e06-4e44-94e0-c3868f88323b): created successfully Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df275dd-1e3c-4a86-8fe1-2e2b7dd9e933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Flow 'volume_create_manager' (aa644fc8-3a3e-4829-b5fe-19feba3184dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:00 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-79cc60fb-7e89-49a4-a455-62921d18634b tempest-VolumesGetTest-881579056 None] Created volume successfully. Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Flow 'volume_create_manager' (6c9f0ae7-80b9-49f9-92b7-bb4839941191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4828c0ea-d0ac-439e-8226-9da92219e082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4828c0ea-d0ac-439e-8226-9da92219e082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:45:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-344462113',display_name='tempest-VolumesGetTest-Volume-531350014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=220fa2e0-ae16-42e9-9276-763ff59ebca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c0814326234f9dbe067e5f91604189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:45:01Z,use_quota=True,user_id='ecd0056fc4f04044861284d1cee987bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc639aed-a739-4b65-8ef8-ac3383fab275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc639aed-a739-4b65-8ef8-ac3383fab275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef7c7c0-c5af-4cfc-bda4-c72d63b974aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef7c7c0-c5af-4cfc-bda4-c72d63b974aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '220fa2e0-ae16-42e9-9276-763ff59ebca7', 'volume_name': 'volume-220fa2e0-ae16-42e9-9276-763ff59ebca7', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a1ff483-725a-4521-82c6-983dddaed68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a1ff483-725a-4521-82c6-983dddaed68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3af4a223-5036-48d4-9678-d1176608f6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:00 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Volume 220fa2e0-ae16-42e9-9276-763ff59ebca7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-220fa2e0-ae16-42e9-9276-763ff59ebca7', 'volume_size': 1} Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:45:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-344462113',display_name='tempest-VolumesGetTest-Volume-531350014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=220fa2e0-ae16-42e9-9276-763ff59ebca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c0814326234f9dbe067e5f91604189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:45:01Z,use_quota=True,user_id='ecd0056fc4f04044861284d1cee987bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Creating volume 220fa2e0-ae16-42e9-9276-763ff59ebca7 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:45:00 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:45:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-220fa2e0-ae16-42e9-9276-763ff59ebca7 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:00 devstack sudo[89815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-220fa2e0-ae16-42e9-9276-763ff59ebca7 1073741824 Apr 02 12:45:00 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:01 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-220fa2e0-ae16-42e9-9276-763ff59ebca7 1073741824" returned: 0 in 0.437s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-220fa2e0-ae16-42e9-9276-763ff59ebca7 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:01 devstack sudo[89820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-220fa2e0-ae16-42e9-9276-763ff59ebca7 Apr 02 12:45:01 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:01 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-220fa2e0-ae16-42e9-9276-763ff59ebca7" returned: 0 in 0.372s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:01 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:45:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3af4a223-5036-48d4-9678-d1176608f6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-220fa2e0-ae16-42e9-9276-763ff59ebca7', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf43a3c-6756-458b-8cb1-ca3dab85001d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:01 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Volume volume-220fa2e0-ae16-42e9-9276-763ff59ebca7 (220fa2e0-ae16-42e9-9276-763ff59ebca7): created successfully Apr 02 12:45:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf43a3c-6756-458b-8cb1-ca3dab85001d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Flow 'volume_create_manager' (6c9f0ae7-80b9-49f9-92b7-bb4839941191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:01 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-e8fb80c4-22f2-4c18-ab45-9539c137ec2f tempest-VolumesGetTest-881579056 None] Created volume successfully. Apr 02 12:45:01 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f44311f2-7506-400e-805d-efe5c87ec186 tempest-VolumesGetTest-881579056 None] Acquiring lock "cinder-220fa2e0-ae16-42e9-9276-763ff59ebca7-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:01 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f44311f2-7506-400e-805d-efe5c87ec186 tempest-VolumesGetTest-881579056 None] Lock "cinder-220fa2e0-ae16-42e9-9276-763ff59ebca7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:02 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f44311f2-7506-400e-805d-efe5c87ec186 tempest-VolumesGetTest-881579056 None] Acquiring lock "cinder-quobyte-220fa2e0-ae16-42e9-9276-763ff59ebca7" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:02 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f44311f2-7506-400e-805d-efe5c87ec186 tempest-VolumesGetTest-881579056 None] Lock "cinder-quobyte-220fa2e0-ae16-42e9-9276-763ff59ebca7" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:02 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6896e9-563e-4f62-bf3a-3d79c2f85704]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:45:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f44311f2-7506-400e-805d-efe5c87ec186 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-220fa2e0-ae16-42e9-9276-763ff59ebca7 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:02 devstack sudo[89823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-220fa2e0-ae16-42e9-9276-763ff59ebca7 Apr 02 12:45:02 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:02 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f44311f2-7506-400e-805d-efe5c87ec186 tempest-VolumesGetTest-881579056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-220fa2e0-ae16-42e9-9276-763ff59ebca7" returned: 0 in 0.423s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f44311f2-7506-400e-805d-efe5c87ec186 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-220fa2e0-ae16-42e9-9276-763ff59ebca7 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:02 devstack sudo[89828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-220fa2e0-ae16-42e9-9276-763ff59ebca7 Apr 02 12:45:02 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:02 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f44311f2-7506-400e-805d-efe5c87ec186 tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-220fa2e0-ae16-42e9-9276-763ff59ebca7" returned: 0 in 0.365s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:02 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f44311f2-7506-400e-805d-efe5c87ec186 tempest-VolumesGetTest-881579056 None] Lock "cinder-quobyte-220fa2e0-ae16-42e9-9276-763ff59ebca7" released by "delete_volume" :: held 0.809s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:02 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-f44311f2-7506-400e-805d-efe5c87ec186 tempest-VolumesGetTest-881579056 None] Created reservations ['3f055d3a-e6bf-4ca2-878a-62590f65a56f', '859e9666-81f4-41de-ac68-1c8210079548', '7301de44-edcd-4253-9e0c-945686de9f47', 'de0802f3-b573-453c-afa0-39dc6fa2c30f'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:45:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-f44311f2-7506-400e-805d-efe5c87ec186 tempest-VolumesGetTest-881579056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-f44311f2-7506-400e-805d-efe5c87ec186 tempest-VolumesGetTest-881579056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:02 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-f44311f2-7506-400e-805d-efe5c87ec186 tempest-VolumesGetTest-881579056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:02 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-f44311f2-7506-400e-805d-efe5c87ec186 tempest-VolumesGetTest-881579056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-f44311f2-7506-400e-805d-efe5c87ec186 tempest-VolumesGetTest-881579056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f44311f2-7506-400e-805d-efe5c87ec186 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:02 devstack sudo[89831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:45:02 devstack sudo[89831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:03 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ab5cb1e3-511a-4ab0-b9d7-0d41438bd0dd tempest-VolumesGetTest-881579056 None] Acquiring lock "cinder-ce637708-2e06-4e44-94e0-c3868f88323b-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:03 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ab5cb1e3-511a-4ab0-b9d7-0d41438bd0dd tempest-VolumesGetTest-881579056 None] Lock "cinder-ce637708-2e06-4e44-94e0-c3868f88323b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:03 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ab5cb1e3-511a-4ab0-b9d7-0d41438bd0dd tempest-VolumesGetTest-881579056 None] Acquiring lock "cinder-quobyte-ce637708-2e06-4e44-94e0-c3868f88323b" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:03 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ab5cb1e3-511a-4ab0-b9d7-0d41438bd0dd tempest-VolumesGetTest-881579056 None] Lock "cinder-quobyte-ce637708-2e06-4e44-94e0-c3868f88323b" acquired by "delete_volume" :: waited 0.014s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:03 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b08fbe-3351-435e-80d7-5e8add696445]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:45:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ab5cb1e3-511a-4ab0-b9d7-0d41438bd0dd tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ce637708-2e06-4e44-94e0-c3868f88323b {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:03 devstack sudo[89833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ce637708-2e06-4e44-94e0-c3868f88323b Apr 02 12:45:03 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:03 devstack sudo[89831]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f44311f2-7506-400e-805d-efe5c87ec186 tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.384s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:03 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-f44311f2-7506-400e-805d-efe5c87ec186 tempest-VolumesGetTest-881579056 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:45:03 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-f44311f2-7506-400e-805d-efe5c87ec186 tempest-VolumesGetTest-881579056 None] Deleted volume successfully. Apr 02 12:45:03 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f44311f2-7506-400e-805d-efe5c87ec186 tempest-VolumesGetTest-881579056 None] Lock "cinder-220fa2e0-ae16-42e9-9276-763ff59ebca7-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:03 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ab5cb1e3-511a-4ab0-b9d7-0d41438bd0dd tempest-VolumesGetTest-881579056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ce637708-2e06-4e44-94e0-c3868f88323b" returned: 0 in 0.443s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ab5cb1e3-511a-4ab0-b9d7-0d41438bd0dd tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ce637708-2e06-4e44-94e0-c3868f88323b {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:03 devstack sudo[89839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ce637708-2e06-4e44-94e0-c3868f88323b Apr 02 12:45:03 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:03 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ab5cb1e3-511a-4ab0-b9d7-0d41438bd0dd tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ce637708-2e06-4e44-94e0-c3868f88323b" returned: 0 in 0.370s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ab5cb1e3-511a-4ab0-b9d7-0d41438bd0dd tempest-VolumesGetTest-881579056 None] Lock "cinder-quobyte-ce637708-2e06-4e44-94e0-c3868f88323b" released by "delete_volume" :: held 0.832s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-ab5cb1e3-511a-4ab0-b9d7-0d41438bd0dd tempest-VolumesGetTest-881579056 None] Created reservations ['bf0c583f-e634-45d4-bc5e-deb71888f395', '38634776-55cd-4533-b9f3-4e3eb919ff95', '30fa4b14-d038-4916-b1f9-b0ca51e531c8', 'a92907d2-bbb7-4e37-ac96-490119a5ba4b'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ab5cb1e3-511a-4ab0-b9d7-0d41438bd0dd tempest-VolumesGetTest-881579056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ab5cb1e3-511a-4ab0-b9d7-0d41438bd0dd tempest-VolumesGetTest-881579056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ab5cb1e3-511a-4ab0-b9d7-0d41438bd0dd tempest-VolumesGetTest-881579056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ab5cb1e3-511a-4ab0-b9d7-0d41438bd0dd tempest-VolumesGetTest-881579056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ab5cb1e3-511a-4ab0-b9d7-0d41438bd0dd tempest-VolumesGetTest-881579056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ab5cb1e3-511a-4ab0-b9d7-0d41438bd0dd tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:04 devstack sudo[89842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:45:04 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:45:04 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Flow 'volume_create_manager' (87f6dcb0-a0d8-4f2e-8c92-4f620efd8783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0495bffb-d018-4e6a-a74a-128dd73880fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ab5cb1e3-511a-4ab0-b9d7-0d41438bd0dd tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.443s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-ab5cb1e3-511a-4ab0-b9d7-0d41438bd0dd tempest-VolumesGetTest-881579056 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:45:04 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-ab5cb1e3-511a-4ab0-b9d7-0d41438bd0dd tempest-VolumesGetTest-881579056 None] Deleted volume successfully. Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0495bffb-d018-4e6a-a74a-128dd73880fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-315808970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c999add-e77a-4fe2-86ee-bf02064ec53a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c0814326234f9dbe067e5f91604189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:45:04Z,use_quota=True,user_id='ecd0056fc4f04044861284d1cee987bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b94c330d-b7c8-4b22-acce-5d2d3efe5c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b94c330d-b7c8-4b22-acce-5d2d3efe5c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd24d58-4012-4575-a5d3-acb6d7702872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd24d58-4012-4575-a5d3-acb6d7702872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c999add-e77a-4fe2-86ee-bf02064ec53a', 'volume_name': 'volume-0c999add-e77a-4fe2-86ee-bf02064ec53a', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe01662d-2d0d-4c14-9383-378f7d1c6ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe01662d-2d0d-4c14-9383-378f7d1c6ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1168e88-9a18-46b2-8362-2d14750ccd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:04 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Volume 0c999add-e77a-4fe2-86ee-bf02064ec53a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c999add-e77a-4fe2-86ee-bf02064ec53a', 'volume_size': 1} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-315808970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c999add-e77a-4fe2-86ee-bf02064ec53a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c0814326234f9dbe067e5f91604189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:45:04Z,use_quota=True,user_id='ecd0056fc4f04044861284d1cee987bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Creating volume 0c999add-e77a-4fe2-86ee-bf02064ec53a {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:45:04 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ab5cb1e3-511a-4ab0-b9d7-0d41438bd0dd tempest-VolumesGetTest-881579056 None] Lock "cinder-ce637708-2e06-4e44-94e0-c3868f88323b-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:04 devstack sudo[89846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a 1073741824 Apr 02 12:45:04 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:04 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a 1073741824" returned: 0 in 0.428s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:05 devstack sudo[89851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a Apr 02 12:45:05 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:05 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a" returned: 0 in 0.361s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:05 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:45:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1168e88-9a18-46b2-8362-2d14750ccd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c999add-e77a-4fe2-86ee-bf02064ec53a', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bad990e2-d357-4d8c-acc7-df88231874d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:05 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Volume volume-0c999add-e77a-4fe2-86ee-bf02064ec53a (0c999add-e77a-4fe2-86ee-bf02064ec53a): created successfully Apr 02 12:45:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bad990e2-d357-4d8c-acc7-df88231874d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Flow 'volume_create_manager' (87f6dcb0-a0d8-4f2e-8c92-4f620efd8783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:05 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-b5ff5f85-f55f-41c1-b75b-25d1a3648b70 tempest-VolumesGetTest-881579056 None] Created volume successfully. Apr 02 12:45:05 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:45:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Flow 'volume_create_manager' (1fcc1cd4-9c27-43ce-8fed-208ab7f6b1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f821c3-0804-4aed-b4ea-cee172ffea61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f821c3-0804-4aed-b4ea-cee172ffea61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1703038197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41d9694a-a425-4b19-9920-cb8056394c5f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b9c0814326234f9dbe067e5f91604189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0c999add-e77a-4fe2-86ee-bf02064ec53a,status='creating',terminated_at=None,updated_at=2026-04-02T10:45:06Z,use_quota=True,user_id='ecd0056fc4f04044861284d1cee987bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a2dc556-e8d6-4420-9a7f-1b4d04b667e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a2dc556-e8d6-4420-9a7f-1b4d04b667e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72013689-4475-4a10-a7ee-f25f8c68426e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72013689-4475-4a10-a7ee-f25f8c68426e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '41d9694a-a425-4b19-9920-cb8056394c5f', 'volume_name': 'volume-41d9694a-a425-4b19-9920-cb8056394c5f', 'volume_size': 1, 'source_volid': '0c999add-e77a-4fe2-86ee-bf02064ec53a', 'source_volstatus': 'available'}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d2c595-50b2-4c8d-84c7-4d0c495adb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d2c595-50b2-4c8d-84c7-4d0c495adb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:05 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ffa7803-120c-43de-9bc2-492beb48b00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:05 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Volume 41d9694a-a425-4b19-9920-cb8056394c5f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-41d9694a-a425-4b19-9920-cb8056394c5f', 'volume_size': 1, 'source_volid': '0c999add-e77a-4fe2-86ee-bf02064ec53a', 'source_volstatus': 'available'} Apr 02 12:45:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:05 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Cloning volume 0c999add-e77a-4fe2-86ee-bf02064ec53a to volume 41d9694a-a425-4b19-9920-cb8056394c5f Apr 02 12:45:05 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Creating offline snapshot a2b395a4-92da-483e-8c00-55bff4071dc8 of volume 0c999add-e77a-4fe2-86ee-bf02064ec53a {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:45:05 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[63881fee-6652-41f5-a583-1bdad2e62266]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:45:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:05 devstack sudo[89854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a Apr 02 12:45:05 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:06 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a" returned: 0 in 0.422s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.a2b395a4-92da-483e-8c00-55bff4071dc8 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:06 devstack sudo[89859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.a2b395a4-92da-483e-8c00-55bff4071dc8 1G Apr 02 12:45:06 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:06 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.a2b395a4-92da-483e-8c00-55bff4071dc8 1G" returned: 0 in 0.417s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c999add-e77a-4fe2-86ee-bf02064ec53a -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.a2b395a4-92da-483e-8c00-55bff4071dc8 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:06 devstack sudo[89864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c999add-e77a-4fe2-86ee-bf02064ec53a -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.a2b395a4-92da-483e-8c00-55bff4071dc8 Apr 02 12:45:06 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:07 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c999add-e77a-4fe2-86ee-bf02064ec53a -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.a2b395a4-92da-483e-8c00-55bff4071dc8" returned: 0 in 0.373s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:07 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.a2b395a4-92da-483e-8c00-55bff4071dc8 is being set with open permissions: ugo+rw Apr 02 12:45:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.a2b395a4-92da-483e-8c00-55bff4071dc8 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:07 devstack sudo[89869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.a2b395a4-92da-483e-8c00-55bff4071dc8 Apr 02 12:45:07 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:07 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.a2b395a4-92da-483e-8c00-55bff4071dc8" returned: 0 in 0.362s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:07 devstack sudo[89872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.info Apr 02 12:45:07 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:07 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.info" returned: 0 in 0.374s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:07 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.info is being set with open permissions: ugo+rw Apr 02 12:45:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:07 devstack sudo[89876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.info Apr 02 12:45:07 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:08 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.info" returned: 0 in 0.360s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:08 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Acquiring lock "cinder-quobyte-41d9694a-a425-4b19-9920-cb8056394c5f" by "_copy_volume_from_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:08 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Lock "cinder-quobyte-41d9694a-a425-4b19-9920-cb8056394c5f" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:08 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] snapshot: a2b395a4-92da-483e-8c00-55bff4071dc8, volume: 41d9694a-a425-4b19-9920-cb8056394c5f, {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 12:45:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:08 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:08 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:08 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44493ac-048e-4c36-a8ac-a547d82a16a7]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:45:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.a2b395a4-92da-483e-8c00-55bff4071dc8 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:08 devstack sudo[89879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.a2b395a4-92da-483e-8c00-55bff4071dc8 Apr 02 12:45:08 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:08 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.a2b395a4-92da-483e-8c00-55bff4071dc8" returned: 0 in 0.419s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:08 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c999add-e77a-4fe2-86ee-bf02064ec53a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:45:08 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 12:45:08 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Creating direct copy from snapshot {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 12:45:08 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b93d52-bae5-4793-9ca6-7b9123868d6c]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:45:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:08 devstack sudo[89884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a Apr 02 12:45:08 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:09 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a" returned: 0 in 0.419s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:09 devstack cinder-volume[82819]: DEBUG cinder.utils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Path /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-41d9694a-a425-4b19-9920-cb8056394c5f not found in is_blk_device check {{(pid=82819) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 12:45:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-41d9694a-a425-4b19-9920-cb8056394c5f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:09 devstack sudo[89891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-41d9694a-a425-4b19-9920-cb8056394c5f Apr 02 12:45:09 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:10 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-41d9694a-a425-4b19-9920-cb8056394c5f" returned: 0 in 1.814s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:10 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9181a9a-40bc-404c-a8df-aea94cb1dd73]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:45:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:10 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a Apr 02 12:45:10 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:11 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a" returned: 0 in 0.541s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:11 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a, size 1024.00 MB, duration 1.82 sec, destination /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-41d9694a-a425-4b19-9920-cb8056394c5f {{(pid=82819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 12:45:11 devstack cinder-volume[82819]: INFO cinder.image.image_utils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Converted 1024.00 MB image at 564.16 MB/s Apr 02 12:45:11 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-41d9694a-a425-4b19-9920-cb8056394c5f is being set with open permissions: ugo+rw Apr 02 12:45:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-41d9694a-a425-4b19-9920-cb8056394c5f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:11 devstack sudo[89908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-41d9694a-a425-4b19-9920-cb8056394c5f Apr 02 12:45:11 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:11 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-41d9694a-a425-4b19-9920-cb8056394c5f" returned: 0 in 0.398s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:11 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Lock "cinder-quobyte-41d9694a-a425-4b19-9920-cb8056394c5f" released by "_copy_volume_from_snapshot" :: held 3.639s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:11 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Acquiring lock "cinder-quobyte-a2b395a4-92da-483e-8c00-55bff4071dc8" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:11 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Lock "cinder-quobyte-a2b395a4-92da-483e-8c00-55bff4071dc8" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:11 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Deleting offline snapshot a2b395a4-92da-483e-8c00-55bff4071dc8 of volume 0c999add-e77a-4fe2-86ee-bf02064ec53a {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:45:11 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] snapshot_file for this snap is: volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.a2b395a4-92da-483e-8c00-55bff4071dc8 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:45:11 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[53edf2d2-f5fe-4d8e-a531-985eaca92d98]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:45:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.a2b395a4-92da-483e-8c00-55bff4071dc8 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:11 devstack sudo[89911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.a2b395a4-92da-483e-8c00-55bff4071dc8 Apr 02 12:45:11 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:12 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.a2b395a4-92da-483e-8c00-55bff4071dc8" returned: 0 in 0.433s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:12 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c999add-e77a-4fe2-86ee-bf02064ec53a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:45:12 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fc011d-0e02-4afc-904a-ce4a1cb81f65]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:45:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:12 devstack sudo[89916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a Apr 02 12:45:12 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:12 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a" returned: 0 in 0.434s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.a2b395a4-92da-483e-8c00-55bff4071dc8 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:12 devstack sudo[89921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.a2b395a4-92da-483e-8c00-55bff4071dc8 Apr 02 12:45:12 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:13 devstack cinder-volume[82819]: DEBUG oslo_service.periodic_task [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82819) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 12:45:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:13 devstack sudo[89923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:45:13 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:13 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.a2b395a4-92da-483e-8c00-55bff4071dc8" returned: 0 in 0.417s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.a2b395a4-92da-483e-8c00-55bff4071dc8 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:13 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.a2b395a4-92da-483e-8c00-55bff4071dc8 Apr 02 12:45:13 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:13 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.412s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:13 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:45:13 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a.a2b395a4-92da-483e-8c00-55bff4071dc8" returned: 0 in 0.370s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:13 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Lock "cinder-quobyte-a2b395a4-92da-483e-8c00-55bff4071dc8" released by "_delete_snapshot" :: held 1.694s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 7.738s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:13 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ffa7803-120c-43de-9bc2-492beb48b00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41d9694a-a425-4b19-9920-cb8056394c5f', 'volume_size': 1, 'source_volid': '0c999add-e77a-4fe2-86ee-bf02064ec53a', 'source_volstatus': 'available'}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:13 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14039a53-df28-4b0f-b6c6-bbd3060d5c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:13 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Volume volume-41d9694a-a425-4b19-9920-cb8056394c5f (41d9694a-a425-4b19-9920-cb8056394c5f): created successfully Apr 02 12:45:13 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14039a53-df28-4b0f-b6c6-bbd3060d5c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:13 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Flow 'volume_create_manager' (1fcc1cd4-9c27-43ce-8fed-208ab7f6b1ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:13 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-df81d688-5a1a-4347-9d3c-78ead7ac6d6a tempest-VolumesGetTest-881579056 None] Created volume successfully. Apr 02 12:45:14 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:45:14 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Flow 'volume_create_manager' (eefb93a9-3356-4a79-9bc1-bb7a73631673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:14 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d610a90f-0fef-4de0-a757-56949e5c17d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:14 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d610a90f-0fef-4de0-a757-56949e5c17d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:45:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1729187103',display_name='tempest-VolumesGetTest-Volume-534528744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=373487be-cd51-4858-b128-ed710367c7c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c0814326234f9dbe067e5f91604189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:45:15Z,use_quota=True,user_id='ecd0056fc4f04044861284d1cee987bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:14 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48ada33e-592a-49be-bd98-78ad87e8b799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:14 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48ada33e-592a-49be-bd98-78ad87e8b799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:14 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aebcfe9-081e-4500-a73a-7bce62965f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:14 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aebcfe9-081e-4500-a73a-7bce62965f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '373487be-cd51-4858-b128-ed710367c7c5', 'volume_name': 'volume-373487be-cd51-4858-b128-ed710367c7c5', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:14 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c0cfcb-2c72-4096-8857-b4e8271a0f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:14 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c0cfcb-2c72-4096-8857-b4e8271a0f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:14 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (366c4ca3-4ce8-4cd6-9660-9161be832475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:14 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Volume 373487be-cd51-4858-b128-ed710367c7c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-373487be-cd51-4858-b128-ed710367c7c5', 'volume_size': 1} Apr 02 12:45:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:14 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:45:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1729187103',display_name='tempest-VolumesGetTest-Volume-534528744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=373487be-cd51-4858-b128-ed710367c7c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c0814326234f9dbe067e5f91604189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:45:15Z,use_quota=True,user_id='ecd0056fc4f04044861284d1cee987bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:45:14 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Creating volume 373487be-cd51-4858-b128-ed710367c7c5 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:45:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:14 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:14 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:14 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:45:14 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:45:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-373487be-cd51-4858-b128-ed710367c7c5 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:14 devstack sudo[89932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-373487be-cd51-4858-b128-ed710367c7c5 1073741824 Apr 02 12:45:14 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:15 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-373487be-cd51-4858-b128-ed710367c7c5 1073741824" returned: 0 in 0.428s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-373487be-cd51-4858-b128-ed710367c7c5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:15 devstack sudo[89937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-373487be-cd51-4858-b128-ed710367c7c5 Apr 02 12:45:15 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:15 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-373487be-cd51-4858-b128-ed710367c7c5" returned: 0 in 0.360s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:15 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:45:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:15 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (366c4ca3-4ce8-4cd6-9660-9161be832475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-373487be-cd51-4858-b128-ed710367c7c5', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:15 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a7654a7-7d04-48f1-a39d-50e68d56a62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:15 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Volume volume-373487be-cd51-4858-b128-ed710367c7c5 (373487be-cd51-4858-b128-ed710367c7c5): created successfully Apr 02 12:45:15 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a7654a7-7d04-48f1-a39d-50e68d56a62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:15 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Flow 'volume_create_manager' (eefb93a9-3356-4a79-9bc1-bb7a73631673) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:15 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-58dc0fae-b301-4567-a325-d1703d1590a3 tempest-VolumesGetTest-881579056 None] Created volume successfully. Apr 02 12:45:15 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b548916b-9f98-4f27-b0a7-22eff8697070 tempest-VolumesGetTest-881579056 None] Acquiring lock "cinder-373487be-cd51-4858-b128-ed710367c7c5-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:15 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b548916b-9f98-4f27-b0a7-22eff8697070 tempest-VolumesGetTest-881579056 None] Lock "cinder-373487be-cd51-4858-b128-ed710367c7c5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:15 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b548916b-9f98-4f27-b0a7-22eff8697070 tempest-VolumesGetTest-881579056 None] Acquiring lock "cinder-quobyte-373487be-cd51-4858-b128-ed710367c7c5" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:15 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b548916b-9f98-4f27-b0a7-22eff8697070 tempest-VolumesGetTest-881579056 None] Lock "cinder-quobyte-373487be-cd51-4858-b128-ed710367c7c5" acquired by "delete_volume" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:15 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd60606-a569-4e22-8121-195e82d31885]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:45:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b548916b-9f98-4f27-b0a7-22eff8697070 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-373487be-cd51-4858-b128-ed710367c7c5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:15 devstack sudo[89940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-373487be-cd51-4858-b128-ed710367c7c5 Apr 02 12:45:15 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:16 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b548916b-9f98-4f27-b0a7-22eff8697070 tempest-VolumesGetTest-881579056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-373487be-cd51-4858-b128-ed710367c7c5" returned: 0 in 0.418s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b548916b-9f98-4f27-b0a7-22eff8697070 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-373487be-cd51-4858-b128-ed710367c7c5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:16 devstack sudo[89945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-373487be-cd51-4858-b128-ed710367c7c5 Apr 02 12:45:16 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:16 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b548916b-9f98-4f27-b0a7-22eff8697070 tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-373487be-cd51-4858-b128-ed710367c7c5" returned: 0 in 0.367s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b548916b-9f98-4f27-b0a7-22eff8697070 tempest-VolumesGetTest-881579056 None] Lock "cinder-quobyte-373487be-cd51-4858-b128-ed710367c7c5" released by "delete_volume" :: held 0.806s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:16 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:SELECT=69,cinder:UPDATE=83,cinder:INSERT=20,cinder:DELETE=8 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:45:16 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-b548916b-9f98-4f27-b0a7-22eff8697070 tempest-VolumesGetTest-881579056 None] Created reservations ['e73dab15-4d0e-44ce-a4c5-13481be41056', 'ac4bffb2-a8f5-42db-981c-6ec4f916a198', 'f7c70a8b-db51-400f-8471-10132c5aac91', 'e29c9bed-ecf6-42f2-a187-0f572b72e4b7'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:45:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b548916b-9f98-4f27-b0a7-22eff8697070 tempest-VolumesGetTest-881579056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b548916b-9f98-4f27-b0a7-22eff8697070 tempest-VolumesGetTest-881579056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:16 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b548916b-9f98-4f27-b0a7-22eff8697070 tempest-VolumesGetTest-881579056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:16 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b548916b-9f98-4f27-b0a7-22eff8697070 tempest-VolumesGetTest-881579056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b548916b-9f98-4f27-b0a7-22eff8697070 tempest-VolumesGetTest-881579056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b548916b-9f98-4f27-b0a7-22eff8697070 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:16 devstack sudo[89948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:45:16 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3093e006-7539-42f0-9c2f-a1c8f0d33202 tempest-VolumesGetTest-881579056 None] Acquiring lock "cinder-41d9694a-a425-4b19-9920-cb8056394c5f-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3093e006-7539-42f0-9c2f-a1c8f0d33202 tempest-VolumesGetTest-881579056 None] Lock "cinder-41d9694a-a425-4b19-9920-cb8056394c5f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3093e006-7539-42f0-9c2f-a1c8f0d33202 tempest-VolumesGetTest-881579056 None] Acquiring lock "cinder-quobyte-41d9694a-a425-4b19-9920-cb8056394c5f" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3093e006-7539-42f0-9c2f-a1c8f0d33202 tempest-VolumesGetTest-881579056 None] Lock "cinder-quobyte-41d9694a-a425-4b19-9920-cb8056394c5f" acquired by "delete_volume" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:16 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[95848f93-42fd-4228-b5eb-008a12e937f0]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:45:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3093e006-7539-42f0-9c2f-a1c8f0d33202 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-41d9694a-a425-4b19-9920-cb8056394c5f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:16 devstack sudo[89950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-41d9694a-a425-4b19-9920-cb8056394c5f Apr 02 12:45:16 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:17 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b548916b-9f98-4f27-b0a7-22eff8697070 tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.395s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:17 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-b548916b-9f98-4f27-b0a7-22eff8697070 tempest-VolumesGetTest-881579056 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:45:17 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-b548916b-9f98-4f27-b0a7-22eff8697070 tempest-VolumesGetTest-881579056 None] Deleted volume successfully. Apr 02 12:45:17 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b548916b-9f98-4f27-b0a7-22eff8697070 tempest-VolumesGetTest-881579056 None] Lock "cinder-373487be-cd51-4858-b128-ed710367c7c5-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:17 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3093e006-7539-42f0-9c2f-a1c8f0d33202 tempest-VolumesGetTest-881579056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-41d9694a-a425-4b19-9920-cb8056394c5f" returned: 0 in 0.421s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3093e006-7539-42f0-9c2f-a1c8f0d33202 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-41d9694a-a425-4b19-9920-cb8056394c5f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:17 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-41d9694a-a425-4b19-9920-cb8056394c5f Apr 02 12:45:17 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:17 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3093e006-7539-42f0-9c2f-a1c8f0d33202 tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-41d9694a-a425-4b19-9920-cb8056394c5f" returned: 0 in 0.366s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:17 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3093e006-7539-42f0-9c2f-a1c8f0d33202 tempest-VolumesGetTest-881579056 None] Lock "cinder-quobyte-41d9694a-a425-4b19-9920-cb8056394c5f" released by "delete_volume" :: held 0.807s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:17 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-3093e006-7539-42f0-9c2f-a1c8f0d33202 tempest-VolumesGetTest-881579056 None] Created reservations ['a0d3fee8-4769-4444-aac0-10361877db83', '1a889245-9009-4849-8bca-48ac246e6f99', '4e42784a-0c99-42b7-88b5-cc96550e31e2', '9afdc752-2426-4bf1-bdea-ef98176fd903'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:45:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3093e006-7539-42f0-9c2f-a1c8f0d33202 tempest-VolumesGetTest-881579056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3093e006-7539-42f0-9c2f-a1c8f0d33202 tempest-VolumesGetTest-881579056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:17 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3093e006-7539-42f0-9c2f-a1c8f0d33202 tempest-VolumesGetTest-881579056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:17 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3093e006-7539-42f0-9c2f-a1c8f0d33202 tempest-VolumesGetTest-881579056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3093e006-7539-42f0-9c2f-a1c8f0d33202 tempest-VolumesGetTest-881579056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3093e006-7539-42f0-9c2f-a1c8f0d33202 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:17 devstack sudo[89960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:45:17 devstack sudo[89960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-88657fd3-e5ab-4e1d-aa40-212c53298ea6 tempest-VolumesGetTest-881579056 None] Acquiring lock "cinder-0c999add-e77a-4fe2-86ee-bf02064ec53a-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-88657fd3-e5ab-4e1d-aa40-212c53298ea6 tempest-VolumesGetTest-881579056 None] Lock "cinder-0c999add-e77a-4fe2-86ee-bf02064ec53a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-88657fd3-e5ab-4e1d-aa40-212c53298ea6 tempest-VolumesGetTest-881579056 None] Acquiring lock "cinder-quobyte-0c999add-e77a-4fe2-86ee-bf02064ec53a" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-88657fd3-e5ab-4e1d-aa40-212c53298ea6 tempest-VolumesGetTest-881579056 None] Lock "cinder-quobyte-0c999add-e77a-4fe2-86ee-bf02064ec53a" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:18 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[67db1f9b-c24d-4d91-8fbc-aef69f256d37]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:45:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-88657fd3-e5ab-4e1d-aa40-212c53298ea6 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:18 devstack sudo[89962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a Apr 02 12:45:18 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:18 devstack sudo[89960]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3093e006-7539-42f0-9c2f-a1c8f0d33202 tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.398s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:18 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-3093e006-7539-42f0-9c2f-a1c8f0d33202 tempest-VolumesGetTest-881579056 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:45:18 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-3093e006-7539-42f0-9c2f-a1c8f0d33202 tempest-VolumesGetTest-881579056 None] Deleted volume successfully. Apr 02 12:45:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-3093e006-7539-42f0-9c2f-a1c8f0d33202 tempest-VolumesGetTest-881579056 None] Lock "cinder-41d9694a-a425-4b19-9920-cb8056394c5f-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:18 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-88657fd3-e5ab-4e1d-aa40-212c53298ea6 tempest-VolumesGetTest-881579056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a" returned: 0 in 0.433s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-88657fd3-e5ab-4e1d-aa40-212c53298ea6 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:18 devstack sudo[89968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a Apr 02 12:45:18 devstack sudo[89968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:18 devstack sudo[89968]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-88657fd3-e5ab-4e1d-aa40-212c53298ea6 tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0c999add-e77a-4fe2-86ee-bf02064ec53a" returned: 0 in 0.360s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-88657fd3-e5ab-4e1d-aa40-212c53298ea6 tempest-VolumesGetTest-881579056 None] Lock "cinder-quobyte-0c999add-e77a-4fe2-86ee-bf02064ec53a" released by "delete_volume" :: held 0.818s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:18 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-88657fd3-e5ab-4e1d-aa40-212c53298ea6 tempest-VolumesGetTest-881579056 None] Created reservations ['604a9b8e-64bd-474c-802b-de0c5f404e62', '757c5acc-03e3-45be-9c17-cd38e3f512e9', 'feb49b8f-5623-4c02-ac20-a10e14974445', '6a214e4c-ce63-42c6-bf49-d9860ff61e70'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:45:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-88657fd3-e5ab-4e1d-aa40-212c53298ea6 tempest-VolumesGetTest-881579056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-88657fd3-e5ab-4e1d-aa40-212c53298ea6 tempest-VolumesGetTest-881579056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:18 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-88657fd3-e5ab-4e1d-aa40-212c53298ea6 tempest-VolumesGetTest-881579056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:18 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-88657fd3-e5ab-4e1d-aa40-212c53298ea6 tempest-VolumesGetTest-881579056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-88657fd3-e5ab-4e1d-aa40-212c53298ea6 tempest-VolumesGetTest-881579056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-88657fd3-e5ab-4e1d-aa40-212c53298ea6 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:18 devstack sudo[89971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:45:18 devstack sudo[89971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:19 devstack sudo[89971]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-88657fd3-e5ab-4e1d-aa40-212c53298ea6 tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.386s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:19 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-88657fd3-e5ab-4e1d-aa40-212c53298ea6 tempest-VolumesGetTest-881579056 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:45:19 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-88657fd3-e5ab-4e1d-aa40-212c53298ea6 tempest-VolumesGetTest-881579056 None] Deleted volume successfully. Apr 02 12:45:19 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-88657fd3-e5ab-4e1d-aa40-212c53298ea6 tempest-VolumesGetTest-881579056 None] Lock "cinder-0c999add-e77a-4fe2-86ee-bf02064ec53a-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:19 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:45:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Flow 'volume_create_manager' (6b6fdafa-d9fa-469a-94f9-a687d4ec1704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a200fe2b-43ce-4a35-b79b-96616cb32cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a200fe2b-43ce-4a35-b79b-96616cb32cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1545873481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c31117c4-971e-4475-ade4-fb57b73cc297,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b9c0814326234f9dbe067e5f91604189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:45:20Z,use_quota=True,user_id='ecd0056fc4f04044861284d1cee987bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6580f44c-04b9-455f-9c4f-f3163bd8360f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6580f44c-04b9-455f-9c4f-f3163bd8360f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41361cc5-ee23-414f-9139-098c9664c249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:19 devstack cinder-volume[82819]: DEBUG cinder.image.glance [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Creating Keystone auth plugin from conf {{(pid=82819) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 02 12:45:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41361cc5-ee23-414f-9139-098c9664c249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c31117c4-971e-4475-ade4-fb57b73cc297', 'volume_name': 'volume-c31117c4-971e-4475-ade4-fb57b73cc297', 'volume_size': 1, 'image_id': '361107cd-f0bc-4798-a524-aa6f2b337172', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/361107cd-f0bc-4798-a524-aa6f2b337172', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd668ace29fed46e98c54f346600c750f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '361107cd-f0bc-4798-a524-aa6f2b337172', 'created_at': datetime.datetime(2026, 4, 2, 10, 29, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 10, 29, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/361107cd-f0bc-4798-a524-aa6f2b337172/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48ca074-19fb-43df-aadb-5225890a6046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48ca074-19fb-43df-aadb-5225890a6046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71060ab8-15f8-4853-9e1f-1678d11e944b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:19 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Volume c31117c4-971e-4475-ade4-fb57b73cc297: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c31117c4-971e-4475-ade4-fb57b73cc297', 'volume_size': 1, 'image_id': '361107cd-f0bc-4798-a524-aa6f2b337172', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/361107cd-f0bc-4798-a524-aa6f2b337172', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd668ace29fed46e98c54f346600c750f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '361107cd-f0bc-4798-a524-aa6f2b337172', 'created_at': datetime.datetime(2026, 4, 2, 10, 29, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 10, 29, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/361107cd-f0bc-4798-a524-aa6f2b337172/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 02 12:45:19 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Trying to clone c31117c4-971e-4475-ade4-fb57b73cc297 from image 361107cd-f0bc-4798-a524-aa6f2b337172 at location (None, [{'url': 'file:///opt/stack/data/glance/images/361107cd-f0bc-4798-a524-aa6f2b337172', 'metadata': {}}]). {{(pid=82819) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 02 12:45:19 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_0n1zebaydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82819) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 02 12:45:19 devstack cinder-volume[82819]: INFO cinder.image.image_utils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Image download 20.69 MB at 20.69 MB/s Apr 02 12:45:19 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fac3c98-898d-4dee-9db0-a3a1cf1340a5]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:45:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_0n1zebaydevstack@QuobyteHD {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:19 devstack sudo[89975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_0n1zebaydevstack@QuobyteHD Apr 02 12:45:19 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:20 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_0n1zebaydevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:20 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Temporary image 361107cd-f0bc-4798-a524-aa6f2b337172 is fetched for user ecd0056fc4f04044861284d1cee987bd. {{(pid=82819) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 02 12:45:20 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb1b9e9-21b9-4921-80a0-128c5ba2b182]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:45:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_0n1zebaydevstack@QuobyteHD {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:20 devstack sudo[89980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_0n1zebaydevstack@QuobyteHD Apr 02 12:45:20 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:20 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_0n1zebaydevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:20 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1545873481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c31117c4-971e-4475-ade4-fb57b73cc297,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b9c0814326234f9dbe067e5f91604189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:45:20Z,use_quota=True,user_id='ecd0056fc4f04044861284d1cee987bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:45:20 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Creating volume c31117c4-971e-4475-ade4-fb57b73cc297 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:45:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:20 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:20 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:20 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:45:20 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:45:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:20 devstack sudo[89985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297 1073741824 Apr 02 12:45:20 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:21 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297 1073741824" returned: 0 in 0.434s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:21 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297 Apr 02 12:45:21 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:21 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297" returned: 0 in 0.375s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:21 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:45:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:21 devstack cinder-volume[82819]: DEBUG cinder.volume.volume_utils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Attempting download of 361107cd-f0bc-4798-a524-aa6f2b337172 ((None, [{'url': 'file:///opt/stack/data/glance/images/361107cd-f0bc-4798-a524-aa6f2b337172', 'metadata': {}}])) to volume c31117c4-971e-4475-ade4-fb57b73cc297. {{(pid=82819) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 02 12:45:21 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcbf20f-d6e9-42d9-9828-b76e12dcf752]: (4, 'raw') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:45:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_361107cd-f0bc-4798-a524-aa6f2b337172_9rhgpg6b {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:21 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_361107cd-f0bc-4798-a524-aa6f2b337172_9rhgpg6b Apr 02 12:45:21 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:22 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_361107cd-f0bc-4798-a524-aa6f2b337172_9rhgpg6b" returned: 0 in 0.412s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_361107cd-f0bc-4798-a524-aa6f2b337172_9rhgpg6b {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:22 devstack sudo[89997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_361107cd-f0bc-4798-a524-aa6f2b337172_9rhgpg6b Apr 02 12:45:22 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:22 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_361107cd-f0bc-4798-a524-aa6f2b337172_9rhgpg6b" returned: 1 in 0.412s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_361107cd-f0bc-4798-a524-aa6f2b337172_9rhgpg6b' failed. Not Retrying. {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 12:45:22 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a67841-c446-405f-8feb-9e2a3ecc1099]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:45:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_0n1zebaydevstack@QuobyteHD {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:22 devstack sudo[90001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_0n1zebaydevstack@QuobyteHD Apr 02 12:45:22 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:22 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_0n1zebaydevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:22 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] 361107cd-f0bc-4798-a524-aa6f2b337172 was qcow2, converting to raw {{(pid=82819) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 02 12:45:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_0n1zebaydevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:22 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_0n1zebaydevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297 Apr 02 12:45:22 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:23 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_0n1zebaydevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297" returned: 0 in 0.741s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:23 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_361107cd-f0bc-4798-a524-aa6f2b337172_0n1zebaydevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297 {{(pid=82819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 12:45:23 devstack cinder-volume[82819]: INFO cinder.image.image_utils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Converted 112.00 MB image at 112.00 MB/s Apr 02 12:45:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:23 devstack sudo[90022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297 1G Apr 02 12:45:23 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:24 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297 1G" returned: 0 in 0.395s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:24 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf73353-49d4-476b-bb13-9454e64a43ee]: (4, 'raw') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:45:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:24 devstack sudo[90027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297 Apr 02 12:45:24 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:24 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297" returned: 0 in 0.414s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:24 devstack sudo[90031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297 Apr 02 12:45:24 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:24 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297" returned: 1 in 0.421s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297' failed. Not Retrying. {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 12:45:24 devstack cinder-volume[82819]: DEBUG cinder.volume.volume_utils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Downloaded image 361107cd-f0bc-4798-a524-aa6f2b337172 ((None, [{'url': 'file:///opt/stack/data/glance/images/361107cd-f0bc-4798-a524-aa6f2b337172', 'metadata': {}}])) to volume c31117c4-971e-4475-ade4-fb57b73cc297 successfully. {{(pid=82819) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 02 12:45:24 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Temporary image 361107cd-f0bc-4798-a524-aa6f2b337172 for user ecd0056fc4f04044861284d1cee987bd is deleted. {{(pid=82819) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 02 12:45:24 devstack cinder-volume[82819]: DEBUG cinder.volume.volume_utils [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Marking volume c31117c4-971e-4475-ade4-fb57b73cc297 as bootable. {{(pid=82819) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 02 12:45:24 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:SELECT=84,cinder:UPDATE=96,cinder:INSERT=33,cinder:DELETE=5 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:45:24 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Copying metadata from image 361107cd-f0bc-4798-a524-aa6f2b337172 to c31117c4-971e-4475-ade4-fb57b73cc297. {{(pid=82819) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 02 12:45:24 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Creating volume glance metadata for volume c31117c4-971e-4475-ade4-fb57b73cc297 backed by image 361107cd-f0bc-4798-a524-aa6f2b337172 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '361107cd-f0bc-4798-a524-aa6f2b337172', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82819) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 02 12:45:24 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71060ab8-15f8-4853-9e1f-1678d11e944b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c31117c4-971e-4475-ade4-fb57b73cc297', 'volume_size': 1, 'image_id': '361107cd-f0bc-4798-a524-aa6f2b337172', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/361107cd-f0bc-4798-a524-aa6f2b337172', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd668ace29fed46e98c54f346600c750f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '361107cd-f0bc-4798-a524-aa6f2b337172', 'created_at': datetime.datetime(2026, 4, 2, 10, 29, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 10, 29, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/361107cd-f0bc-4798-a524-aa6f2b337172/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:24 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ac9335-0a1b-498d-9e0b-a5cf608a5e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:24 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Volume volume-c31117c4-971e-4475-ade4-fb57b73cc297 (c31117c4-971e-4475-ade4-fb57b73cc297): created successfully Apr 02 12:45:25 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ac9335-0a1b-498d-9e0b-a5cf608a5e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:25 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Flow 'volume_create_manager' (6b6fdafa-d9fa-469a-94f9-a687d4ec1704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:25 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-fe7a104a-678f-4f96-87dc-21d9aae60f82 tempest-VolumesGetTest-881579056 None] Created volume successfully. Apr 02 12:45:26 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:45:26 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Flow 'volume_create_manager' (272fd9ea-7f10-4b94-b34d-9e604c11c1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:26 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be534c77-26d7-485e-a59f-64aa43fe0007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:26 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be534c77-26d7-485e-a59f-64aa43fe0007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:45:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1936498044',display_name='tempest-VolumesGetTest-Volume-544727275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d4e7d8-b824-4794-b943-3f6d37c6b79d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c0814326234f9dbe067e5f91604189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:45:26Z,use_quota=True,user_id='ecd0056fc4f04044861284d1cee987bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:26 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83bd0d4a-f837-40e9-9881-c29ec648b020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:26 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83bd0d4a-f837-40e9-9881-c29ec648b020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:26 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69266f17-d7bd-42ad-81a1-449c38e29811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:26 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69266f17-d7bd-42ad-81a1-449c38e29811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2d4e7d8-b824-4794-b943-3f6d37c6b79d', 'volume_name': 'volume-d2d4e7d8-b824-4794-b943-3f6d37c6b79d', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:26 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4e297f-c080-42b4-a27f-2cee0e96b052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:26 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4e297f-c080-42b4-a27f-2cee0e96b052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:26 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3192a6f-4990-4706-95a1-7a9b17692178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:26 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Volume d2d4e7d8-b824-4794-b943-3f6d37c6b79d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2d4e7d8-b824-4794-b943-3f6d37c6b79d', 'volume_size': 1} Apr 02 12:45:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:26 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:45:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1936498044',display_name='tempest-VolumesGetTest-Volume-544727275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d4e7d8-b824-4794-b943-3f6d37c6b79d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c0814326234f9dbe067e5f91604189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:45:26Z,use_quota=True,user_id='ecd0056fc4f04044861284d1cee987bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:45:26 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Creating volume d2d4e7d8-b824-4794-b943-3f6d37c6b79d {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:45:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:26 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:26 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:26 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:45:26 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:45:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d2d4e7d8-b824-4794-b943-3f6d37c6b79d 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:26 devstack sudo[90036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d2d4e7d8-b824-4794-b943-3f6d37c6b79d 1073741824 Apr 02 12:45:26 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:26 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d2d4e7d8-b824-4794-b943-3f6d37c6b79d 1073741824" returned: 0 in 0.430s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d2d4e7d8-b824-4794-b943-3f6d37c6b79d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:26 devstack sudo[90041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d2d4e7d8-b824-4794-b943-3f6d37c6b79d Apr 02 12:45:26 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:27 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d2d4e7d8-b824-4794-b943-3f6d37c6b79d" returned: 0 in 0.359s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:27 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:45:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:27 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3192a6f-4990-4706-95a1-7a9b17692178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2d4e7d8-b824-4794-b943-3f6d37c6b79d', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:27 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5409f1d-8bc9-4d04-951b-07e6f164f78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:27 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Volume volume-d2d4e7d8-b824-4794-b943-3f6d37c6b79d (d2d4e7d8-b824-4794-b943-3f6d37c6b79d): created successfully Apr 02 12:45:27 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5409f1d-8bc9-4d04-951b-07e6f164f78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:27 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Flow 'volume_create_manager' (272fd9ea-7f10-4b94-b34d-9e604c11c1a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:27 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-a12382e5-c035-432d-a04d-de3e1b8df0f8 tempest-VolumesGetTest-881579056 None] Created volume successfully. Apr 02 12:45:27 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-65a4f198-9872-4ba8-ac78-403f9b1911e8 tempest-VolumesGetTest-881579056 None] Acquiring lock "cinder-d2d4e7d8-b824-4794-b943-3f6d37c6b79d-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:27 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-65a4f198-9872-4ba8-ac78-403f9b1911e8 tempest-VolumesGetTest-881579056 None] Lock "cinder-d2d4e7d8-b824-4794-b943-3f6d37c6b79d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:27 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-65a4f198-9872-4ba8-ac78-403f9b1911e8 tempest-VolumesGetTest-881579056 None] Acquiring lock "cinder-quobyte-d2d4e7d8-b824-4794-b943-3f6d37c6b79d" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:27 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-65a4f198-9872-4ba8-ac78-403f9b1911e8 tempest-VolumesGetTest-881579056 None] Lock "cinder-quobyte-d2d4e7d8-b824-4794-b943-3f6d37c6b79d" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:27 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[41358450-b520-41a9-aeae-3d0c4ec0d179]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:45:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-65a4f198-9872-4ba8-ac78-403f9b1911e8 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d2d4e7d8-b824-4794-b943-3f6d37c6b79d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:27 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d2d4e7d8-b824-4794-b943-3f6d37c6b79d Apr 02 12:45:27 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:27 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-65a4f198-9872-4ba8-ac78-403f9b1911e8 tempest-VolumesGetTest-881579056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d2d4e7d8-b824-4794-b943-3f6d37c6b79d" returned: 0 in 0.414s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:27 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-65a4f198-9872-4ba8-ac78-403f9b1911e8 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d2d4e7d8-b824-4794-b943-3f6d37c6b79d {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:27 devstack sudo[90050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d2d4e7d8-b824-4794-b943-3f6d37c6b79d Apr 02 12:45:27 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:28 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-65a4f198-9872-4ba8-ac78-403f9b1911e8 tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-d2d4e7d8-b824-4794-b943-3f6d37c6b79d" returned: 0 in 0.359s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:28 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-65a4f198-9872-4ba8-ac78-403f9b1911e8 tempest-VolumesGetTest-881579056 None] Lock "cinder-quobyte-d2d4e7d8-b824-4794-b943-3f6d37c6b79d" released by "delete_volume" :: held 0.795s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:28 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-65a4f198-9872-4ba8-ac78-403f9b1911e8 tempest-VolumesGetTest-881579056 None] Created reservations ['e0842fe2-41d7-4d8b-8324-ae18287134d5', '6d04fb58-3fed-4efa-b641-a2742a6e4ef1', 'caeeb4a3-a5d2-47c9-8f91-d69872806ed8', 'fcc0cd88-00ab-4cc4-81c4-d63e580b2cd3'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:45:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-65a4f198-9872-4ba8-ac78-403f9b1911e8 tempest-VolumesGetTest-881579056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-65a4f198-9872-4ba8-ac78-403f9b1911e8 tempest-VolumesGetTest-881579056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:28 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-65a4f198-9872-4ba8-ac78-403f9b1911e8 tempest-VolumesGetTest-881579056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:28 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-65a4f198-9872-4ba8-ac78-403f9b1911e8 tempest-VolumesGetTest-881579056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-65a4f198-9872-4ba8-ac78-403f9b1911e8 tempest-VolumesGetTest-881579056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-65a4f198-9872-4ba8-ac78-403f9b1911e8 tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:28 devstack sudo[90053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:45:28 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:28 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-64a22a4e-6929-41c8-bca4-fa79d256d40f tempest-VolumesGetTest-881579056 None] Acquiring lock "cinder-c31117c4-971e-4475-ade4-fb57b73cc297-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:28 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-64a22a4e-6929-41c8-bca4-fa79d256d40f tempest-VolumesGetTest-881579056 None] Lock "cinder-c31117c4-971e-4475-ade4-fb57b73cc297-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:28 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-64a22a4e-6929-41c8-bca4-fa79d256d40f tempest-VolumesGetTest-881579056 None] Acquiring lock "cinder-quobyte-c31117c4-971e-4475-ade4-fb57b73cc297" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:28 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-64a22a4e-6929-41c8-bca4-fa79d256d40f tempest-VolumesGetTest-881579056 None] Lock "cinder-quobyte-c31117c4-971e-4475-ade4-fb57b73cc297" acquired by "delete_volume" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:28 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d838337-5f15-4e1f-9db2-f676ba12621b]: (4, 'raw') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:45:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-64a22a4e-6929-41c8-bca4-fa79d256d40f tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:28 devstack sudo[90055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297 Apr 02 12:45:28 devstack sudo[90055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:28 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-65a4f198-9872-4ba8-ac78-403f9b1911e8 tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.416s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:28 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-65a4f198-9872-4ba8-ac78-403f9b1911e8 tempest-VolumesGetTest-881579056 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:45:28 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-65a4f198-9872-4ba8-ac78-403f9b1911e8 tempest-VolumesGetTest-881579056 None] Deleted volume successfully. Apr 02 12:45:28 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-65a4f198-9872-4ba8-ac78-403f9b1911e8 tempest-VolumesGetTest-881579056 None] Lock "cinder-d2d4e7d8-b824-4794-b943-3f6d37c6b79d-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:29 devstack sudo[90055]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-64a22a4e-6929-41c8-bca4-fa79d256d40f tempest-VolumesGetTest-881579056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297" returned: 0 in 0.418s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-64a22a4e-6929-41c8-bca4-fa79d256d40f tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:29 devstack sudo[90060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297 Apr 02 12:45:29 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:29 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-64a22a4e-6929-41c8-bca4-fa79d256d40f tempest-VolumesGetTest-881579056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297" returned: 1 in 0.415s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-64a22a4e-6929-41c8-bca4-fa79d256d40f tempest-VolumesGetTest-881579056 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297' failed. Not Retrying. {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 12:45:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-64a22a4e-6929-41c8-bca4-fa79d256d40f tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:29 devstack sudo[90065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297 Apr 02 12:45:29 devstack sudo[90065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:29 devstack sudo[90065]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-64a22a4e-6929-41c8-bca4-fa79d256d40f tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-c31117c4-971e-4475-ade4-fb57b73cc297" returned: 0 in 0.372s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:29 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-64a22a4e-6929-41c8-bca4-fa79d256d40f tempest-VolumesGetTest-881579056 None] Lock "cinder-quobyte-c31117c4-971e-4475-ade4-fb57b73cc297" released by "delete_volume" :: held 1.239s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:29 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-64a22a4e-6929-41c8-bca4-fa79d256d40f tempest-VolumesGetTest-881579056 None] Created reservations ['a047e142-7994-4fa9-8b9b-e489c35c1bd6', '422f7fb3-9a66-4cda-9b6e-376c05cebcf0', '59267fa6-0dd9-4ff2-8830-7fd5a6228164', '737585a6-db82-4c4b-947c-3e7468efaf35'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:45:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-64a22a4e-6929-41c8-bca4-fa79d256d40f tempest-VolumesGetTest-881579056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-64a22a4e-6929-41c8-bca4-fa79d256d40f tempest-VolumesGetTest-881579056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:29 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-64a22a4e-6929-41c8-bca4-fa79d256d40f tempest-VolumesGetTest-881579056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:29 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-64a22a4e-6929-41c8-bca4-fa79d256d40f tempest-VolumesGetTest-881579056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-64a22a4e-6929-41c8-bca4-fa79d256d40f tempest-VolumesGetTest-881579056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-64a22a4e-6929-41c8-bca4-fa79d256d40f tempest-VolumesGetTest-881579056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:29 devstack sudo[90068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:45:29 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:30 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-64a22a4e-6929-41c8-bca4-fa79d256d40f tempest-VolumesGetTest-881579056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.357s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:30 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-64a22a4e-6929-41c8-bca4-fa79d256d40f tempest-VolumesGetTest-881579056 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:45:30 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-64a22a4e-6929-41c8-bca4-fa79d256d40f tempest-VolumesGetTest-881579056 None] Deleted volume successfully. Apr 02 12:45:30 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-64a22a4e-6929-41c8-bca4-fa79d256d40f tempest-VolumesGetTest-881579056 None] Lock "cinder-c31117c4-971e-4475-ade4-fb57b73cc297-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:32 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:45:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Flow 'volume_create_manager' (b2c7e1f4-0577-4695-9f11-b1f73d95fb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba6cb76-e565-4c1c-9f4a-7a82b6724cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba6cb76-e565-4c1c-9f4a-7a82b6724cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1147558036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92c34823-f4e0-4ce2-b6a5-e8243a8610c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='12e13b75a82f4fab99987d91dbe8405d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:45:32Z,use_quota=True,user_id='d2ded23e65d7466c981466082dbb5910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (714264cc-681b-482f-a99e-bdb7b762e942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (714264cc-681b-482f-a99e-bdb7b762e942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (395eaff7-ba78-4682-b3a8-0746f19f94e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (395eaff7-ba78-4682-b3a8-0746f19f94e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92c34823-f4e0-4ce2-b6a5-e8243a8610c5', 'volume_name': 'volume-92c34823-f4e0-4ce2-b6a5-e8243a8610c5', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e298531f-7473-4a38-8e2c-4981c579caa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e298531f-7473-4a38-8e2c-4981c579caa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e30556-c361-4436-bc7d-4efc120158f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:32 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Volume 92c34823-f4e0-4ce2-b6a5-e8243a8610c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92c34823-f4e0-4ce2-b6a5-e8243a8610c5', 'volume_size': 1} Apr 02 12:45:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1147558036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92c34823-f4e0-4ce2-b6a5-e8243a8610c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='12e13b75a82f4fab99987d91dbe8405d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:45:32Z,use_quota=True,user_id='d2ded23e65d7466c981466082dbb5910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:45:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Creating volume 92c34823-f4e0-4ce2-b6a5-e8243a8610c5 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:45:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:45:32 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:45:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-92c34823-f4e0-4ce2-b6a5-e8243a8610c5 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:32 devstack sudo[90072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-92c34823-f4e0-4ce2-b6a5-e8243a8610c5 1073741824 Apr 02 12:45:32 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:32 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-92c34823-f4e0-4ce2-b6a5-e8243a8610c5 1073741824" returned: 0 in 0.432s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-92c34823-f4e0-4ce2-b6a5-e8243a8610c5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:32 devstack sudo[90077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-92c34823-f4e0-4ce2-b6a5-e8243a8610c5 Apr 02 12:45:32 devstack sudo[90077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:33 devstack sudo[90077]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-92c34823-f4e0-4ce2-b6a5-e8243a8610c5" returned: 0 in 0.359s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e30556-c361-4436-bc7d-4efc120158f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92c34823-f4e0-4ce2-b6a5-e8243a8610c5', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02438b12-d105-4aef-bfc4-43c692dde64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:33 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Volume volume-92c34823-f4e0-4ce2-b6a5-e8243a8610c5 (92c34823-f4e0-4ce2-b6a5-e8243a8610c5): created successfully Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02438b12-d105-4aef-bfc4-43c692dde64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Flow 'volume_create_manager' (b2c7e1f4-0577-4695-9f11-b1f73d95fb9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:33 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-59226715-b326-4ab0-8cc6-f231d63a2353 tempest-VolumesListTestJSON-1888582547 None] Created volume successfully. Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Flow 'volume_create_manager' (4c2f9936-1661-4cf2-80bc-b5a0807d1a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4e200f-204a-4052-a276-a65d92a20527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4e200f-204a-4052-a276-a65d92a20527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-988761637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34816006-faac-4dd9-9d2a-b1d87ca04a72,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='12e13b75a82f4fab99987d91dbe8405d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:45:33Z,use_quota=True,user_id='d2ded23e65d7466c981466082dbb5910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (759b72d4-b114-4c24-b2fd-ceac21dfb206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (759b72d4-b114-4c24-b2fd-ceac21dfb206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a83fd32-64cf-4973-bae2-47aace4f6af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a83fd32-64cf-4973-bae2-47aace4f6af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34816006-faac-4dd9-9d2a-b1d87ca04a72', 'volume_name': 'volume-34816006-faac-4dd9-9d2a-b1d87ca04a72', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36fc79c-bd00-4dc5-b41d-a17857a12af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36fc79c-bd00-4dc5-b41d-a17857a12af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d510938c-89d9-4766-b34b-efb698710aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:33 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Volume 34816006-faac-4dd9-9d2a-b1d87ca04a72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34816006-faac-4dd9-9d2a-b1d87ca04a72', 'volume_size': 1} Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-988761637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34816006-faac-4dd9-9d2a-b1d87ca04a72,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='12e13b75a82f4fab99987d91dbe8405d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:45:33Z,use_quota=True,user_id='d2ded23e65d7466c981466082dbb5910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Creating volume 34816006-faac-4dd9-9d2a-b1d87ca04a72 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:45:33 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-34816006-faac-4dd9-9d2a-b1d87ca04a72 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:33 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-34816006-faac-4dd9-9d2a-b1d87ca04a72 1073741824 Apr 02 12:45:33 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:33 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-34816006-faac-4dd9-9d2a-b1d87ca04a72 1073741824" returned: 0 in 0.437s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-34816006-faac-4dd9-9d2a-b1d87ca04a72 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:34 devstack sudo[90085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-34816006-faac-4dd9-9d2a-b1d87ca04a72 Apr 02 12:45:34 devstack sudo[90085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:34 devstack sudo[90085]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-34816006-faac-4dd9-9d2a-b1d87ca04a72" returned: 0 in 0.364s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d510938c-89d9-4766-b34b-efb698710aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34816006-faac-4dd9-9d2a-b1d87ca04a72', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6a6535-2e65-4f2c-b06b-466da2843a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:34 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Volume volume-34816006-faac-4dd9-9d2a-b1d87ca04a72 (34816006-faac-4dd9-9d2a-b1d87ca04a72): created successfully Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6a6535-2e65-4f2c-b06b-466da2843a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Flow 'volume_create_manager' (4c2f9936-1661-4cf2-80bc-b5a0807d1a90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:34 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-39500466-63a5-41aa-88d0-cecc5079b666 tempest-VolumesListTestJSON-1888582547 None] Created volume successfully. Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Flow 'volume_create_manager' (c75f9360-9cdc-4a19-bbe8-a2e9951e9351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66817309-d2fe-4273-a012-a50a7784cab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66817309-d2fe-4273-a012-a50a7784cab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-220341870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a889cbf2-b82d-4343-ac6b-9851ff555954,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='12e13b75a82f4fab99987d91dbe8405d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:45:35Z,use_quota=True,user_id='d2ded23e65d7466c981466082dbb5910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dbcd152-2c87-4c20-ba45-a126cc9ff112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dbcd152-2c87-4c20-ba45-a126cc9ff112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28a671b-0363-45d7-a2ba-5cf45697e588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28a671b-0363-45d7-a2ba-5cf45697e588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a889cbf2-b82d-4343-ac6b-9851ff555954', 'volume_name': 'volume-a889cbf2-b82d-4343-ac6b-9851ff555954', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c4eec9-14c9-4dbe-9d93-aa4ef9d11755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c4eec9-14c9-4dbe-9d93-aa4ef9d11755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5d8a11-dbb9-49c0-b733-ec045d1f294a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:34 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Volume a889cbf2-b82d-4343-ac6b-9851ff555954: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a889cbf2-b82d-4343-ac6b-9851ff555954', 'volume_size': 1} Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-220341870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a889cbf2-b82d-4343-ac6b-9851ff555954,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='12e13b75a82f4fab99987d91dbe8405d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:45:35Z,use_quota=True,user_id='d2ded23e65d7466c981466082dbb5910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Creating volume a889cbf2-b82d-4343-ac6b-9851ff555954 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:45:34 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:45:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a889cbf2-b82d-4343-ac6b-9851ff555954 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:34 devstack sudo[90088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a889cbf2-b82d-4343-ac6b-9851ff555954 1073741824 Apr 02 12:45:34 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:35 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a889cbf2-b82d-4343-ac6b-9851ff555954 1073741824" returned: 0 in 0.456s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a889cbf2-b82d-4343-ac6b-9851ff555954 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:35 devstack sudo[90093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a889cbf2-b82d-4343-ac6b-9851ff555954 Apr 02 12:45:35 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:35 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a889cbf2-b82d-4343-ac6b-9851ff555954" returned: 0 in 0.372s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:35 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:45:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:35 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5d8a11-dbb9-49c0-b733-ec045d1f294a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a889cbf2-b82d-4343-ac6b-9851ff555954', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:35 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd407a8a-9436-4aeb-b1df-64eb3d1de084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:35 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Volume volume-a889cbf2-b82d-4343-ac6b-9851ff555954 (a889cbf2-b82d-4343-ac6b-9851ff555954): created successfully Apr 02 12:45:35 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd407a8a-9436-4aeb-b1df-64eb3d1de084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:35 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Flow 'volume_create_manager' (c75f9360-9cdc-4a19-bbe8-a2e9951e9351) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:35 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-e373c72d-e52e-4961-8ca2-7091af4f9ac6 tempest-VolumesListTestJSON-1888582547 None] Created volume successfully. Apr 02 12:45:37 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e5501c72-3622-4c13-b07e-afa7b2f442b0 tempest-VolumesListTestJSON-1888582547 None] Acquiring lock "cinder-a889cbf2-b82d-4343-ac6b-9851ff555954-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:37 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e5501c72-3622-4c13-b07e-afa7b2f442b0 tempest-VolumesListTestJSON-1888582547 None] Lock "cinder-a889cbf2-b82d-4343-ac6b-9851ff555954-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:37 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e5501c72-3622-4c13-b07e-afa7b2f442b0 tempest-VolumesListTestJSON-1888582547 None] Acquiring lock "cinder-quobyte-a889cbf2-b82d-4343-ac6b-9851ff555954" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:37 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e5501c72-3622-4c13-b07e-afa7b2f442b0 tempest-VolumesListTestJSON-1888582547 None] Lock "cinder-quobyte-a889cbf2-b82d-4343-ac6b-9851ff555954" acquired by "delete_volume" :: waited 0.006s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:37 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ac7859-7559-478e-a567-6a20ab630790]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:45:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e5501c72-3622-4c13-b07e-afa7b2f442b0 tempest-VolumesListTestJSON-1888582547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a889cbf2-b82d-4343-ac6b-9851ff555954 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:37 devstack sudo[90097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a889cbf2-b82d-4343-ac6b-9851ff555954 Apr 02 12:45:37 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:38 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e5501c72-3622-4c13-b07e-afa7b2f442b0 tempest-VolumesListTestJSON-1888582547 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a889cbf2-b82d-4343-ac6b-9851ff555954" returned: 0 in 0.418s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e5501c72-3622-4c13-b07e-afa7b2f442b0 tempest-VolumesListTestJSON-1888582547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a889cbf2-b82d-4343-ac6b-9851ff555954 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:38 devstack sudo[90102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a889cbf2-b82d-4343-ac6b-9851ff555954 Apr 02 12:45:38 devstack sudo[90102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:38 devstack sudo[90102]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e5501c72-3622-4c13-b07e-afa7b2f442b0 tempest-VolumesListTestJSON-1888582547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a889cbf2-b82d-4343-ac6b-9851ff555954" returned: 0 in 0.359s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:38 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e5501c72-3622-4c13-b07e-afa7b2f442b0 tempest-VolumesListTestJSON-1888582547 None] Lock "cinder-quobyte-a889cbf2-b82d-4343-ac6b-9851ff555954" released by "delete_volume" :: held 0.801s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:38 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-e5501c72-3622-4c13-b07e-afa7b2f442b0 tempest-VolumesListTestJSON-1888582547 None] Created reservations ['b6a61cf5-e793-488b-9d89-1ba15958bf8b', '0b3a4e3d-dda6-42f3-b91b-f3338507766c', '222740f1-c271-45c1-8ead-c87d79196aa2', '48a2f409-789c-4103-83a6-8fe641fda804'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:45:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e5501c72-3622-4c13-b07e-afa7b2f442b0 tempest-VolumesListTestJSON-1888582547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e5501c72-3622-4c13-b07e-afa7b2f442b0 tempest-VolumesListTestJSON-1888582547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e5501c72-3622-4c13-b07e-afa7b2f442b0 tempest-VolumesListTestJSON-1888582547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e5501c72-3622-4c13-b07e-afa7b2f442b0 tempest-VolumesListTestJSON-1888582547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e5501c72-3622-4c13-b07e-afa7b2f442b0 tempest-VolumesListTestJSON-1888582547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e5501c72-3622-4c13-b07e-afa7b2f442b0 tempest-VolumesListTestJSON-1888582547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:38 devstack sudo[90105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:45:38 devstack sudo[90105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:38 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-30738c98-3df3-47ee-aa92-81dcac4e5e5c tempest-VolumesListTestJSON-1888582547 None] Acquiring lock "cinder-34816006-faac-4dd9-9d2a-b1d87ca04a72-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:38 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-30738c98-3df3-47ee-aa92-81dcac4e5e5c tempest-VolumesListTestJSON-1888582547 None] Lock "cinder-34816006-faac-4dd9-9d2a-b1d87ca04a72-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:38 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-30738c98-3df3-47ee-aa92-81dcac4e5e5c tempest-VolumesListTestJSON-1888582547 None] Acquiring lock "cinder-quobyte-34816006-faac-4dd9-9d2a-b1d87ca04a72" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:38 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-30738c98-3df3-47ee-aa92-81dcac4e5e5c tempest-VolumesListTestJSON-1888582547 None] Lock "cinder-quobyte-34816006-faac-4dd9-9d2a-b1d87ca04a72" acquired by "delete_volume" :: waited 0.016s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:38 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f265fbf5-1c9d-4acf-ab8d-9a2775580731]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:45:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-30738c98-3df3-47ee-aa92-81dcac4e5e5c tempest-VolumesListTestJSON-1888582547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-34816006-faac-4dd9-9d2a-b1d87ca04a72 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:38 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-34816006-faac-4dd9-9d2a-b1d87ca04a72 Apr 02 12:45:38 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:39 devstack sudo[90105]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e5501c72-3622-4c13-b07e-afa7b2f442b0 tempest-VolumesListTestJSON-1888582547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.412s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:39 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-e5501c72-3622-4c13-b07e-afa7b2f442b0 tempest-VolumesListTestJSON-1888582547 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:45:39 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-e5501c72-3622-4c13-b07e-afa7b2f442b0 tempest-VolumesListTestJSON-1888582547 None] Deleted volume successfully. Apr 02 12:45:39 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e5501c72-3622-4c13-b07e-afa7b2f442b0 tempest-VolumesListTestJSON-1888582547 None] Lock "cinder-a889cbf2-b82d-4343-ac6b-9851ff555954-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:39 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-30738c98-3df3-47ee-aa92-81dcac4e5e5c tempest-VolumesListTestJSON-1888582547 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-34816006-faac-4dd9-9d2a-b1d87ca04a72" returned: 0 in 0.422s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-30738c98-3df3-47ee-aa92-81dcac4e5e5c tempest-VolumesListTestJSON-1888582547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-34816006-faac-4dd9-9d2a-b1d87ca04a72 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:39 devstack sudo[90113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-34816006-faac-4dd9-9d2a-b1d87ca04a72 Apr 02 12:45:39 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:39 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-30738c98-3df3-47ee-aa92-81dcac4e5e5c tempest-VolumesListTestJSON-1888582547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-34816006-faac-4dd9-9d2a-b1d87ca04a72" returned: 0 in 0.371s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:39 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-30738c98-3df3-47ee-aa92-81dcac4e5e5c tempest-VolumesListTestJSON-1888582547 None] Lock "cinder-quobyte-34816006-faac-4dd9-9d2a-b1d87ca04a72" released by "delete_volume" :: held 0.812s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:39 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-30738c98-3df3-47ee-aa92-81dcac4e5e5c tempest-VolumesListTestJSON-1888582547 None] Created reservations ['1374a9f0-3107-4fb5-998e-c422dcb139b0', '38f684a7-09c9-46fb-af22-04608030b948', '9306f49e-ffd2-4b45-b8c7-cbd720865477', 'e3d5111b-5af0-4f19-89a9-e788333a80a6'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:45:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-30738c98-3df3-47ee-aa92-81dcac4e5e5c tempest-VolumesListTestJSON-1888582547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-30738c98-3df3-47ee-aa92-81dcac4e5e5c tempest-VolumesListTestJSON-1888582547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:39 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-30738c98-3df3-47ee-aa92-81dcac4e5e5c tempest-VolumesListTestJSON-1888582547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:39 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-30738c98-3df3-47ee-aa92-81dcac4e5e5c tempest-VolumesListTestJSON-1888582547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-30738c98-3df3-47ee-aa92-81dcac4e5e5c tempest-VolumesListTestJSON-1888582547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-30738c98-3df3-47ee-aa92-81dcac4e5e5c tempest-VolumesListTestJSON-1888582547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:39 devstack sudo[90116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:45:39 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:40 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b5fe782c-3b25-476b-850e-93f5d387ff1d tempest-VolumesListTestJSON-1888582547 None] Acquiring lock "cinder-92c34823-f4e0-4ce2-b6a5-e8243a8610c5-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:40 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b5fe782c-3b25-476b-850e-93f5d387ff1d tempest-VolumesListTestJSON-1888582547 None] Lock "cinder-92c34823-f4e0-4ce2-b6a5-e8243a8610c5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:40 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b5fe782c-3b25-476b-850e-93f5d387ff1d tempest-VolumesListTestJSON-1888582547 None] Acquiring lock "cinder-quobyte-92c34823-f4e0-4ce2-b6a5-e8243a8610c5" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:40 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b5fe782c-3b25-476b-850e-93f5d387ff1d tempest-VolumesListTestJSON-1888582547 None] Lock "cinder-quobyte-92c34823-f4e0-4ce2-b6a5-e8243a8610c5" acquired by "delete_volume" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:40 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d47720-4961-4b20-94f6-4d632fffb74d]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:45:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b5fe782c-3b25-476b-850e-93f5d387ff1d tempest-VolumesListTestJSON-1888582547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-92c34823-f4e0-4ce2-b6a5-e8243a8610c5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:40 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-92c34823-f4e0-4ce2-b6a5-e8243a8610c5 Apr 02 12:45:40 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:40 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-30738c98-3df3-47ee-aa92-81dcac4e5e5c tempest-VolumesListTestJSON-1888582547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.393s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:40 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-30738c98-3df3-47ee-aa92-81dcac4e5e5c tempest-VolumesListTestJSON-1888582547 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:45:40 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-30738c98-3df3-47ee-aa92-81dcac4e5e5c tempest-VolumesListTestJSON-1888582547 None] Deleted volume successfully. Apr 02 12:45:40 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-30738c98-3df3-47ee-aa92-81dcac4e5e5c tempest-VolumesListTestJSON-1888582547 None] Lock "cinder-34816006-faac-4dd9-9d2a-b1d87ca04a72-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:40 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b5fe782c-3b25-476b-850e-93f5d387ff1d tempest-VolumesListTestJSON-1888582547 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-92c34823-f4e0-4ce2-b6a5-e8243a8610c5" returned: 0 in 0.433s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b5fe782c-3b25-476b-850e-93f5d387ff1d tempest-VolumesListTestJSON-1888582547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-92c34823-f4e0-4ce2-b6a5-e8243a8610c5 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:40 devstack sudo[90125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-92c34823-f4e0-4ce2-b6a5-e8243a8610c5 Apr 02 12:45:40 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:40 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b5fe782c-3b25-476b-850e-93f5d387ff1d tempest-VolumesListTestJSON-1888582547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-92c34823-f4e0-4ce2-b6a5-e8243a8610c5" returned: 0 in 0.364s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:40 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b5fe782c-3b25-476b-850e-93f5d387ff1d tempest-VolumesListTestJSON-1888582547 None] Lock "cinder-quobyte-92c34823-f4e0-4ce2-b6a5-e8243a8610c5" released by "delete_volume" :: held 0.828s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:40 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-b5fe782c-3b25-476b-850e-93f5d387ff1d tempest-VolumesListTestJSON-1888582547 None] Created reservations ['e6de803c-3438-4536-9aa3-525c6dc0f9f5', '2aa5e278-8606-48b0-95b3-23829146fda1', 'e26b404e-a921-4b79-9673-32019c9f9885', 'c912da84-9268-4483-8da9-8f84cd6ab8c9'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:45:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b5fe782c-3b25-476b-850e-93f5d387ff1d tempest-VolumesListTestJSON-1888582547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b5fe782c-3b25-476b-850e-93f5d387ff1d tempest-VolumesListTestJSON-1888582547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:40 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b5fe782c-3b25-476b-850e-93f5d387ff1d tempest-VolumesListTestJSON-1888582547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:40 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-b5fe782c-3b25-476b-850e-93f5d387ff1d tempest-VolumesListTestJSON-1888582547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-b5fe782c-3b25-476b-850e-93f5d387ff1d tempest-VolumesListTestJSON-1888582547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b5fe782c-3b25-476b-850e-93f5d387ff1d tempest-VolumesListTestJSON-1888582547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:40 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:45:40 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:41 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-b5fe782c-3b25-476b-850e-93f5d387ff1d tempest-VolumesListTestJSON-1888582547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.407s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:41 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-b5fe782c-3b25-476b-850e-93f5d387ff1d tempest-VolumesListTestJSON-1888582547 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:45:41 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-b5fe782c-3b25-476b-850e-93f5d387ff1d tempest-VolumesListTestJSON-1888582547 None] Deleted volume successfully. Apr 02 12:45:41 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-b5fe782c-3b25-476b-850e-93f5d387ff1d tempest-VolumesListTestJSON-1888582547 None] Lock "cinder-92c34823-f4e0-4ce2-b6a5-e8243a8610c5-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Flow 'volume_create_manager' (fe13c4eb-eda0-49a3-8b01-e488164a9819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47325141-d75f-4392-ba28-6b420715c821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47325141-d75f-4392-ba28-6b420715c821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-145526784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=573de3d5-3469-4b68-ba85-3877e2d8bf3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb09d39084674a24a8db86d6cdfe9d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:45:43Z,use_quota=True,user_id='d356af7406c44c75ad72028968b27f6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3379cb-5711-4d18-a3c0-40df708618f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3379cb-5711-4d18-a3c0-40df708618f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244169e3-0f78-40ac-9586-3101377ee8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244169e3-0f78-40ac-9586-3101377ee8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '573de3d5-3469-4b68-ba85-3877e2d8bf3b', 'volume_name': 'volume-573de3d5-3469-4b68-ba85-3877e2d8bf3b', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d6a420-07c5-41aa-a3c6-8a726e2a6592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d6a420-07c5-41aa-a3c6-8a726e2a6592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff60e773-8d9d-427d-b9b7-124c78a51afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:42 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Volume 573de3d5-3469-4b68-ba85-3877e2d8bf3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-573de3d5-3469-4b68-ba85-3877e2d8bf3b', 'volume_size': 1} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-145526784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=573de3d5-3469-4b68-ba85-3877e2d8bf3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb09d39084674a24a8db86d6cdfe9d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:45:43Z,use_quota=True,user_id='d356af7406c44c75ad72028968b27f6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Creating volume 573de3d5-3469-4b68-ba85-3877e2d8bf3b {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:45:42 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-573de3d5-3469-4b68-ba85-3877e2d8bf3b 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:42 devstack sudo[90137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-573de3d5-3469-4b68-ba85-3877e2d8bf3b 1073741824 Apr 02 12:45:42 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Flow 'volume_create_manager' (55d4a611-1126-48d9-9083-37684de146b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf4eab0-9aac-494e-8e3e-766f245606b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf4eab0-9aac-494e-8e3e-766f245606b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-297489859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6261a82d-62da-43b4-92a4-810411fdb961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb09d39084674a24a8db86d6cdfe9d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:45:43Z,use_quota=True,user_id='d356af7406c44c75ad72028968b27f6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d9d58b-6cf6-46c1-8b5f-a4c14a5f8612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d9d58b-6cf6-46c1-8b5f-a4c14a5f8612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb7c7202-9cd5-4baf-9a74-cf027d2400c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb7c7202-9cd5-4baf-9a74-cf027d2400c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6261a82d-62da-43b4-92a4-810411fdb961', 'volume_name': 'volume-6261a82d-62da-43b4-92a4-810411fdb961', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e058863a-ad64-46cc-ae80-b5fdd40325c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e058863a-ad64-46cc-ae80-b5fdd40325c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74dae70d-6a0d-4472-9668-adb8a52a02c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:42 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Volume 6261a82d-62da-43b4-92a4-810411fdb961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6261a82d-62da-43b4-92a4-810411fdb961', 'volume_size': 1} Apr 02 12:45:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Flow 'volume_create_manager' (d23031d8-d755-4490-9e92-c2f359b578a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c69019b0-ae64-433b-b47d-ca88bee3ee80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c69019b0-ae64-433b-b47d-ca88bee3ee80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-724370613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=311627a3-854a-49cb-8884-22ac47903202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb09d39084674a24a8db86d6cdfe9d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:45:43Z,use_quota=True,user_id='d356af7406c44c75ad72028968b27f6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44a43458-72fc-4c5c-9351-b379819f72b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44a43458-72fc-4c5c-9351-b379819f72b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6930caf1-0486-445b-b711-58bf4d4a4de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6930caf1-0486-445b-b711-58bf4d4a4de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '311627a3-854a-49cb-8884-22ac47903202', 'volume_name': 'volume-311627a3-854a-49cb-8884-22ac47903202', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f779704-2644-4134-bfba-545a476c7ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f779704-2644-4134-bfba-545a476c7ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccca54aa-0443-4d70-b5e3-3f5c144d0c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:43 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Volume 311627a3-854a-49cb-8884-22ac47903202: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-311627a3-854a-49cb-8884-22ac47903202', 'volume_size': 1} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Flow 'volume_create_manager' (d222a0b3-8c2a-49f7-83f8-70273a403c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d7042c-1d3f-4519-91b1-7da57f055764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d7042c-1d3f-4519-91b1-7da57f055764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-529087961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e3ab0b-6dde-44dc-941c-ac28dbf595de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb09d39084674a24a8db86d6cdfe9d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:45:43Z,use_quota=True,user_id='d356af7406c44c75ad72028968b27f6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0115246d-bb48-46d4-87a4-976b7acebfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0115246d-bb48-46d4-87a4-976b7acebfca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166218b9-a4d8-43cc-8efa-a2f02f02974a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166218b9-a4d8-43cc-8efa-a2f02f02974a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23e3ab0b-6dde-44dc-941c-ac28dbf595de', 'volume_name': 'volume-23e3ab0b-6dde-44dc-941c-ac28dbf595de', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5fba62-364d-425b-b666-55e9ecbec6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5fba62-364d-425b-b666-55e9ecbec6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a031bd-f090-4678-9b1b-ec13b82007f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:43 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Volume 23e3ab0b-6dde-44dc-941c-ac28dbf595de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23e3ab0b-6dde-44dc-941c-ac28dbf595de', 'volume_size': 1} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:43 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-573de3d5-3469-4b68-ba85-3877e2d8bf3b 1073741824" returned: 0 in 0.564s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-573de3d5-3469-4b68-ba85-3877e2d8bf3b {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:43 devstack sudo[90142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-573de3d5-3469-4b68-ba85-3877e2d8bf3b Apr 02 12:45:43 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Flow 'volume_create_manager' (d23b06c7-145d-46b2-92b3-7860a26453c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909e50d4-ae1e-4358-9444-0e62caddc8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909e50d4-ae1e-4358-9444-0e62caddc8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-530327627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4117e1d-5de8-42ac-8ee2-9e8b63c7011f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb09d39084674a24a8db86d6cdfe9d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:45:43Z,use_quota=True,user_id='d356af7406c44c75ad72028968b27f6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7503898-a3fb-4e91-9180-db5cb9ef7359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7503898-a3fb-4e91-9180-db5cb9ef7359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95bfacf-9137-44ef-a277-804020e06b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95bfacf-9137-44ef-a277-804020e06b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4117e1d-5de8-42ac-8ee2-9e8b63c7011f', 'volume_name': 'volume-f4117e1d-5de8-42ac-8ee2-9e8b63c7011f', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (718d5f4c-defc-4733-a065-9732c12128f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (718d5f4c-defc-4733-a065-9732c12128f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4ab33d-a708-492d-a0dd-84b368535ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:43 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Volume f4117e1d-5de8-42ac-8ee2-9e8b63c7011f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4117e1d-5de8-42ac-8ee2-9e8b63c7011f', 'volume_size': 1} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:43 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-573de3d5-3469-4b68-ba85-3877e2d8bf3b" returned: 0 in 0.422s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.838s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-297489859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6261a82d-62da-43b4-92a4-810411fdb961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb09d39084674a24a8db86d6cdfe9d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:45:43Z,use_quota=True,user_id='d356af7406c44c75ad72028968b27f6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Creating volume 6261a82d-62da-43b4-92a4-810411fdb961 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:45:43 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6261a82d-62da-43b4-92a4-810411fdb961 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff60e773-8d9d-427d-b9b7-124c78a51afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-573de3d5-3469-4b68-ba85-3877e2d8bf3b', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:43 devstack sudo[90145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6261a82d-62da-43b4-92a4-810411fdb961 1073741824 Apr 02 12:45:43 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b57c06-835d-4a16-9e5e-0aa74a97b774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:43 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Volume volume-573de3d5-3469-4b68-ba85-3877e2d8bf3b (573de3d5-3469-4b68-ba85-3877e2d8bf3b): created successfully Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b57c06-835d-4a16-9e5e-0aa74a97b774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Flow 'volume_create_manager' (fe13c4eb-eda0-49a3-8b01-e488164a9819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:43 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-e3a6d094-25ee-41bb-a68b-8b4d3279ede3 tempest-CreateVolumesFromImageTest-1872899652 None] Created volume successfully. Apr 02 12:45:44 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6261a82d-62da-43b4-92a4-810411fdb961 1073741824" returned: 0 in 0.432s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6261a82d-62da-43b4-92a4-810411fdb961 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:44 devstack sudo[90150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6261a82d-62da-43b4-92a4-810411fdb961 Apr 02 12:45:44 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:44 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6261a82d-62da-43b4-92a4-810411fdb961" returned: 0 in 0.389s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:44 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:45:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.512s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:44 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-724370613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=311627a3-854a-49cb-8884-22ac47903202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb09d39084674a24a8db86d6cdfe9d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:45:43Z,use_quota=True,user_id='d356af7406c44c75ad72028968b27f6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:45:44 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Creating volume 311627a3-854a-49cb-8884-22ac47903202 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:45:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:44 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:44 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:44 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:45:44 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:45:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-311627a3-854a-49cb-8884-22ac47903202 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74dae70d-6a0d-4472-9668-adb8a52a02c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6261a82d-62da-43b4-92a4-810411fdb961', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:44 devstack sudo[90153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-311627a3-854a-49cb-8884-22ac47903202 1073741824 Apr 02 12:45:44 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28064a7a-4f58-408c-b48a-f11186dc7bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:44 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Volume volume-6261a82d-62da-43b4-92a4-810411fdb961 (6261a82d-62da-43b4-92a4-810411fdb961): created successfully Apr 02 12:45:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28064a7a-4f58-408c-b48a-f11186dc7bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Flow 'volume_create_manager' (55d4a611-1126-48d9-9083-37684de146b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:44 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-729d58e1-583a-409f-929d-b491605c94b8 tempest-CreateVolumesFromImageTest-1872899652 None] Created volume successfully. Apr 02 12:45:45 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-311627a3-854a-49cb-8884-22ac47903202 1073741824" returned: 0 in 0.429s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-311627a3-854a-49cb-8884-22ac47903202 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:45 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-311627a3-854a-49cb-8884-22ac47903202 Apr 02 12:45:45 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:45 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-311627a3-854a-49cb-8884-22ac47903202" returned: 0 in 0.367s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:45 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:45:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.148s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:45 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-529087961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e3ab0b-6dde-44dc-941c-ac28dbf595de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb09d39084674a24a8db86d6cdfe9d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:45:43Z,use_quota=True,user_id='d356af7406c44c75ad72028968b27f6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:45:45 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Creating volume 23e3ab0b-6dde-44dc-941c-ac28dbf595de {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:45:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:45 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:45 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:45 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:45:45 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:45:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-23e3ab0b-6dde-44dc-941c-ac28dbf595de 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:45 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccca54aa-0443-4d70-b5e3-3f5c144d0c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-311627a3-854a-49cb-8884-22ac47903202', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:45 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-23e3ab0b-6dde-44dc-941c-ac28dbf595de 1073741824 Apr 02 12:45:45 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:45 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dfad8d6-889e-4bc1-ab2a-71fee8d7b150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:45 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Volume volume-311627a3-854a-49cb-8884-22ac47903202 (311627a3-854a-49cb-8884-22ac47903202): created successfully Apr 02 12:45:45 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dfad8d6-889e-4bc1-ab2a-71fee8d7b150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:45 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Flow 'volume_create_manager' (d23031d8-d755-4490-9e92-c2f359b578a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:45 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-3e5cc362-9b7e-47f5-918e-631d250e7b4c tempest-CreateVolumesFromImageTest-1872899652 None] Created volume successfully. Apr 02 12:45:45 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-23e3ab0b-6dde-44dc-941c-ac28dbf595de 1073741824" returned: 0 in 0.450s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-23e3ab0b-6dde-44dc-941c-ac28dbf595de {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:46 devstack sudo[90166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-23e3ab0b-6dde-44dc-941c-ac28dbf595de Apr 02 12:45:46 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:46 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-23e3ab0b-6dde-44dc-941c-ac28dbf595de" returned: 0 in 0.359s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:46 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:45:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.769s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:46 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-530327627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4117e1d-5de8-42ac-8ee2-9e8b63c7011f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb09d39084674a24a8db86d6cdfe9d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:45:43Z,use_quota=True,user_id='d356af7406c44c75ad72028968b27f6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:45:46 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Creating volume f4117e1d-5de8-42ac-8ee2-9e8b63c7011f {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:45:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:46 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:46 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:46 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:45:46 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:45:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f4117e1d-5de8-42ac-8ee2-9e8b63c7011f 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:46 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a031bd-f090-4678-9b1b-ec13b82007f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23e3ab0b-6dde-44dc-941c-ac28dbf595de', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:46 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63792360-2bd7-42e6-aaa9-9ce32377230d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:46 devstack sudo[90169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f4117e1d-5de8-42ac-8ee2-9e8b63c7011f 1073741824 Apr 02 12:45:46 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:46 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Volume volume-23e3ab0b-6dde-44dc-941c-ac28dbf595de (23e3ab0b-6dde-44dc-941c-ac28dbf595de): created successfully Apr 02 12:45:46 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63792360-2bd7-42e6-aaa9-9ce32377230d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:46 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Flow 'volume_create_manager' (d222a0b3-8c2a-49f7-83f8-70273a403c24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:46 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-ac4ee327-9596-41be-9760-0ad40c3daf04 tempest-CreateVolumesFromImageTest-1872899652 None] Created volume successfully. Apr 02 12:45:46 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f4117e1d-5de8-42ac-8ee2-9e8b63c7011f 1073741824" returned: 0 in 0.453s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f4117e1d-5de8-42ac-8ee2-9e8b63c7011f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:46 devstack sudo[90174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f4117e1d-5de8-42ac-8ee2-9e8b63c7011f Apr 02 12:45:46 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:47 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f4117e1d-5de8-42ac-8ee2-9e8b63c7011f" returned: 0 in 0.367s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:47 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:45:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4ab33d-a708-492d-a0dd-84b368535ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4117e1d-5de8-42ac-8ee2-9e8b63c7011f', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f045e4d-605e-4408-b477-e976db91f5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:45:47 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Volume volume-f4117e1d-5de8-42ac-8ee2-9e8b63c7011f (f4117e1d-5de8-42ac-8ee2-9e8b63c7011f): created successfully Apr 02 12:45:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f045e4d-605e-4408-b477-e976db91f5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:45:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Flow 'volume_create_manager' (d23b06c7-145d-46b2-92b3-7860a26453c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:45:47 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-3ea836bd-ac5f-4a3a-beae-359b5bb7df2a tempest-CreateVolumesFromImageTest-1872899652 None] Created volume successfully. Apr 02 12:45:47 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-78a04131-6927-45ce-8b3d-fcc7711a26fd tempest-CreateVolumesFromImageTest-1872899652 None] Acquiring lock "cinder-f4117e1d-5de8-42ac-8ee2-9e8b63c7011f-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:47 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-78a04131-6927-45ce-8b3d-fcc7711a26fd tempest-CreateVolumesFromImageTest-1872899652 None] Lock "cinder-f4117e1d-5de8-42ac-8ee2-9e8b63c7011f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:47 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-78a04131-6927-45ce-8b3d-fcc7711a26fd tempest-CreateVolumesFromImageTest-1872899652 None] Acquiring lock "cinder-quobyte-f4117e1d-5de8-42ac-8ee2-9e8b63c7011f" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:47 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-78a04131-6927-45ce-8b3d-fcc7711a26fd tempest-CreateVolumesFromImageTest-1872899652 None] Lock "cinder-quobyte-f4117e1d-5de8-42ac-8ee2-9e8b63c7011f" acquired by "delete_volume" :: waited 0.007s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:47 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb494b1f-b076-48f5-9476-ddcc8f16f024]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:45:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-78a04131-6927-45ce-8b3d-fcc7711a26fd tempest-CreateVolumesFromImageTest-1872899652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f4117e1d-5de8-42ac-8ee2-9e8b63c7011f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:48 devstack sudo[90178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f4117e1d-5de8-42ac-8ee2-9e8b63c7011f Apr 02 12:45:48 devstack sudo[90178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:48 devstack sudo[90178]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-78a04131-6927-45ce-8b3d-fcc7711a26fd tempest-CreateVolumesFromImageTest-1872899652 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f4117e1d-5de8-42ac-8ee2-9e8b63c7011f" returned: 0 in 0.422s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-78a04131-6927-45ce-8b3d-fcc7711a26fd tempest-CreateVolumesFromImageTest-1872899652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f4117e1d-5de8-42ac-8ee2-9e8b63c7011f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:48 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f4117e1d-5de8-42ac-8ee2-9e8b63c7011f Apr 02 12:45:48 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:48 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-78a04131-6927-45ce-8b3d-fcc7711a26fd tempest-CreateVolumesFromImageTest-1872899652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f4117e1d-5de8-42ac-8ee2-9e8b63c7011f" returned: 0 in 0.369s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:48 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-78a04131-6927-45ce-8b3d-fcc7711a26fd tempest-CreateVolumesFromImageTest-1872899652 None] Lock "cinder-quobyte-f4117e1d-5de8-42ac-8ee2-9e8b63c7011f" released by "delete_volume" :: held 0.815s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:48 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-78a04131-6927-45ce-8b3d-fcc7711a26fd tempest-CreateVolumesFromImageTest-1872899652 None] Created reservations ['3346fbf6-4943-4553-88b8-e76ff7f0a331', '232a7592-f362-4d13-8dd8-1a5d4c07bd95', '5918b63d-bb5b-44ac-b62c-a36974275bfd', '21dd3606-d201-4663-bde1-9c93a78e483c'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:45:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-78a04131-6927-45ce-8b3d-fcc7711a26fd tempest-CreateVolumesFromImageTest-1872899652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-78a04131-6927-45ce-8b3d-fcc7711a26fd tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:48 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-78a04131-6927-45ce-8b3d-fcc7711a26fd tempest-CreateVolumesFromImageTest-1872899652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:48 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-78a04131-6927-45ce-8b3d-fcc7711a26fd tempest-CreateVolumesFromImageTest-1872899652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-78a04131-6927-45ce-8b3d-fcc7711a26fd tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-78a04131-6927-45ce-8b3d-fcc7711a26fd tempest-CreateVolumesFromImageTest-1872899652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:48 devstack sudo[90186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:45:48 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:49 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a52b069b-c1f2-4441-985a-8e45ea6b35b2 tempest-CreateVolumesFromImageTest-1872899652 None] Acquiring lock "cinder-23e3ab0b-6dde-44dc-941c-ac28dbf595de-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:49 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a52b069b-c1f2-4441-985a-8e45ea6b35b2 tempest-CreateVolumesFromImageTest-1872899652 None] Lock "cinder-23e3ab0b-6dde-44dc-941c-ac28dbf595de-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:49 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a52b069b-c1f2-4441-985a-8e45ea6b35b2 tempest-CreateVolumesFromImageTest-1872899652 None] Acquiring lock "cinder-quobyte-23e3ab0b-6dde-44dc-941c-ac28dbf595de" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:49 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a52b069b-c1f2-4441-985a-8e45ea6b35b2 tempest-CreateVolumesFromImageTest-1872899652 None] Lock "cinder-quobyte-23e3ab0b-6dde-44dc-941c-ac28dbf595de" acquired by "delete_volume" :: waited 0.018s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:49 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c6a1f6-f75e-48f4-93b3-98503e70d36f]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:45:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a52b069b-c1f2-4441-985a-8e45ea6b35b2 tempest-CreateVolumesFromImageTest-1872899652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-23e3ab0b-6dde-44dc-941c-ac28dbf595de {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:49 devstack sudo[90188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-23e3ab0b-6dde-44dc-941c-ac28dbf595de Apr 02 12:45:49 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:49 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-78a04131-6927-45ce-8b3d-fcc7711a26fd tempest-CreateVolumesFromImageTest-1872899652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.390s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:49 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-78a04131-6927-45ce-8b3d-fcc7711a26fd tempest-CreateVolumesFromImageTest-1872899652 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:45:49 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-78a04131-6927-45ce-8b3d-fcc7711a26fd tempest-CreateVolumesFromImageTest-1872899652 None] Deleted volume successfully. Apr 02 12:45:49 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-78a04131-6927-45ce-8b3d-fcc7711a26fd tempest-CreateVolumesFromImageTest-1872899652 None] Lock "cinder-f4117e1d-5de8-42ac-8ee2-9e8b63c7011f-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:49 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a52b069b-c1f2-4441-985a-8e45ea6b35b2 tempest-CreateVolumesFromImageTest-1872899652 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-23e3ab0b-6dde-44dc-941c-ac28dbf595de" returned: 0 in 0.453s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a52b069b-c1f2-4441-985a-8e45ea6b35b2 tempest-CreateVolumesFromImageTest-1872899652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-23e3ab0b-6dde-44dc-941c-ac28dbf595de {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:49 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-23e3ab0b-6dde-44dc-941c-ac28dbf595de Apr 02 12:45:49 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:49 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a52b069b-c1f2-4441-985a-8e45ea6b35b2 tempest-CreateVolumesFromImageTest-1872899652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-23e3ab0b-6dde-44dc-941c-ac28dbf595de" returned: 0 in 0.367s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:49 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a52b069b-c1f2-4441-985a-8e45ea6b35b2 tempest-CreateVolumesFromImageTest-1872899652 None] Lock "cinder-quobyte-23e3ab0b-6dde-44dc-941c-ac28dbf595de" released by "delete_volume" :: held 0.839s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:49 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-a52b069b-c1f2-4441-985a-8e45ea6b35b2 tempest-CreateVolumesFromImageTest-1872899652 None] Created reservations ['a324dd77-a4f0-43ce-8dc9-805985cfe393', '54ad2c19-90a3-4462-bdc8-53609ecba17d', '47f6d577-ab69-4558-9ef9-fa65a0f2b958', '5cc9dbde-fc6f-4c9b-90f7-e210c6a257c7'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:45:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a52b069b-c1f2-4441-985a-8e45ea6b35b2 tempest-CreateVolumesFromImageTest-1872899652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a52b069b-c1f2-4441-985a-8e45ea6b35b2 tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:49 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a52b069b-c1f2-4441-985a-8e45ea6b35b2 tempest-CreateVolumesFromImageTest-1872899652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:49 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a52b069b-c1f2-4441-985a-8e45ea6b35b2 tempest-CreateVolumesFromImageTest-1872899652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a52b069b-c1f2-4441-985a-8e45ea6b35b2 tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a52b069b-c1f2-4441-985a-8e45ea6b35b2 tempest-CreateVolumesFromImageTest-1872899652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:50 devstack sudo[90197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:45:50 devstack sudo[90197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:50 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c682d2b6-28a8-48b7-bb72-c9ff29662a4e tempest-CreateVolumesFromImageTest-1872899652 None] Acquiring lock "cinder-311627a3-854a-49cb-8884-22ac47903202-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:50 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c682d2b6-28a8-48b7-bb72-c9ff29662a4e tempest-CreateVolumesFromImageTest-1872899652 None] Lock "cinder-311627a3-854a-49cb-8884-22ac47903202-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:50 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c682d2b6-28a8-48b7-bb72-c9ff29662a4e tempest-CreateVolumesFromImageTest-1872899652 None] Acquiring lock "cinder-quobyte-311627a3-854a-49cb-8884-22ac47903202" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:50 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c682d2b6-28a8-48b7-bb72-c9ff29662a4e tempest-CreateVolumesFromImageTest-1872899652 None] Lock "cinder-quobyte-311627a3-854a-49cb-8884-22ac47903202" acquired by "delete_volume" :: waited 0.007s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:50 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe21dab-4a95-4109-b3f8-f0534edd606c]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:45:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c682d2b6-28a8-48b7-bb72-c9ff29662a4e tempest-CreateVolumesFromImageTest-1872899652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-311627a3-854a-49cb-8884-22ac47903202 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:50 devstack sudo[90199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-311627a3-854a-49cb-8884-22ac47903202 Apr 02 12:45:50 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:50 devstack sudo[90197]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a52b069b-c1f2-4441-985a-8e45ea6b35b2 tempest-CreateVolumesFromImageTest-1872899652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.391s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:50 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-a52b069b-c1f2-4441-985a-8e45ea6b35b2 tempest-CreateVolumesFromImageTest-1872899652 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:45:50 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-a52b069b-c1f2-4441-985a-8e45ea6b35b2 tempest-CreateVolumesFromImageTest-1872899652 None] Deleted volume successfully. Apr 02 12:45:50 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-a52b069b-c1f2-4441-985a-8e45ea6b35b2 tempest-CreateVolumesFromImageTest-1872899652 None] Lock "cinder-23e3ab0b-6dde-44dc-941c-ac28dbf595de-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:50 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c682d2b6-28a8-48b7-bb72-c9ff29662a4e tempest-CreateVolumesFromImageTest-1872899652 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-311627a3-854a-49cb-8884-22ac47903202" returned: 0 in 0.433s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c682d2b6-28a8-48b7-bb72-c9ff29662a4e tempest-CreateVolumesFromImageTest-1872899652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-311627a3-854a-49cb-8884-22ac47903202 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:50 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-311627a3-854a-49cb-8884-22ac47903202 Apr 02 12:45:50 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:51 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c682d2b6-28a8-48b7-bb72-c9ff29662a4e tempest-CreateVolumesFromImageTest-1872899652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-311627a3-854a-49cb-8884-22ac47903202" returned: 0 in 0.361s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c682d2b6-28a8-48b7-bb72-c9ff29662a4e tempest-CreateVolumesFromImageTest-1872899652 None] Lock "cinder-quobyte-311627a3-854a-49cb-8884-22ac47903202" released by "delete_volume" :: held 0.825s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:51 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-c682d2b6-28a8-48b7-bb72-c9ff29662a4e tempest-CreateVolumesFromImageTest-1872899652 None] Created reservations ['81761cb9-ee50-4c83-ad19-733c52012b4e', '38790ddf-de1d-46e9-84aa-aeddc83bf507', '856c4d31-08a8-4da0-b192-22dc0ef0327d', 'd2cbabf7-1ce0-418f-acbe-8fab89263712'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:45:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c682d2b6-28a8-48b7-bb72-c9ff29662a4e tempest-CreateVolumesFromImageTest-1872899652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c682d2b6-28a8-48b7-bb72-c9ff29662a4e tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:51 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c682d2b6-28a8-48b7-bb72-c9ff29662a4e tempest-CreateVolumesFromImageTest-1872899652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:51 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c682d2b6-28a8-48b7-bb72-c9ff29662a4e tempest-CreateVolumesFromImageTest-1872899652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c682d2b6-28a8-48b7-bb72-c9ff29662a4e tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c682d2b6-28a8-48b7-bb72-c9ff29662a4e tempest-CreateVolumesFromImageTest-1872899652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:51 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:45:51 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1d9b24ed-0cf2-4c3d-b3d7-fab2d08b759e tempest-CreateVolumesFromImageTest-1872899652 None] Acquiring lock "cinder-6261a82d-62da-43b4-92a4-810411fdb961-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1d9b24ed-0cf2-4c3d-b3d7-fab2d08b759e tempest-CreateVolumesFromImageTest-1872899652 None] Lock "cinder-6261a82d-62da-43b4-92a4-810411fdb961-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1d9b24ed-0cf2-4c3d-b3d7-fab2d08b759e tempest-CreateVolumesFromImageTest-1872899652 None] Acquiring lock "cinder-quobyte-6261a82d-62da-43b4-92a4-810411fdb961" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1d9b24ed-0cf2-4c3d-b3d7-fab2d08b759e tempest-CreateVolumesFromImageTest-1872899652 None] Lock "cinder-quobyte-6261a82d-62da-43b4-92a4-810411fdb961" acquired by "delete_volume" :: waited 0.006s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:51 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c0642b-8ba4-4cbd-966f-e4a25eaff92a]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:45:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1d9b24ed-0cf2-4c3d-b3d7-fab2d08b759e tempest-CreateVolumesFromImageTest-1872899652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6261a82d-62da-43b4-92a4-810411fdb961 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:51 devstack sudo[90210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6261a82d-62da-43b4-92a4-810411fdb961 Apr 02 12:45:51 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:51 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c682d2b6-28a8-48b7-bb72-c9ff29662a4e tempest-CreateVolumesFromImageTest-1872899652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.382s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:51 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-c682d2b6-28a8-48b7-bb72-c9ff29662a4e tempest-CreateVolumesFromImageTest-1872899652 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:45:51 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-c682d2b6-28a8-48b7-bb72-c9ff29662a4e tempest-CreateVolumesFromImageTest-1872899652 None] Deleted volume successfully. Apr 02 12:45:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c682d2b6-28a8-48b7-bb72-c9ff29662a4e tempest-CreateVolumesFromImageTest-1872899652 None] Lock "cinder-311627a3-854a-49cb-8884-22ac47903202-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:51 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1d9b24ed-0cf2-4c3d-b3d7-fab2d08b759e tempest-CreateVolumesFromImageTest-1872899652 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6261a82d-62da-43b4-92a4-810411fdb961" returned: 0 in 0.431s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1d9b24ed-0cf2-4c3d-b3d7-fab2d08b759e tempest-CreateVolumesFromImageTest-1872899652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6261a82d-62da-43b4-92a4-810411fdb961 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:51 devstack sudo[90216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6261a82d-62da-43b4-92a4-810411fdb961 Apr 02 12:45:51 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:52 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1d9b24ed-0cf2-4c3d-b3d7-fab2d08b759e tempest-CreateVolumesFromImageTest-1872899652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-6261a82d-62da-43b4-92a4-810411fdb961" returned: 0 in 0.358s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:52 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1d9b24ed-0cf2-4c3d-b3d7-fab2d08b759e tempest-CreateVolumesFromImageTest-1872899652 None] Lock "cinder-quobyte-6261a82d-62da-43b4-92a4-810411fdb961" released by "delete_volume" :: held 0.817s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:52 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-1d9b24ed-0cf2-4c3d-b3d7-fab2d08b759e tempest-CreateVolumesFromImageTest-1872899652 None] Created reservations ['9d8ccf0b-816e-4bb4-9d36-1cebf0d11255', '84633e44-4adf-410f-b0ee-331e16170aca', '2ae4a97e-3e43-42fc-95b2-2ad729f84fc8', '359c9cd0-4d86-48ea-abad-d3542fbc87cc'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:45:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-1d9b24ed-0cf2-4c3d-b3d7-fab2d08b759e tempest-CreateVolumesFromImageTest-1872899652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-1d9b24ed-0cf2-4c3d-b3d7-fab2d08b759e tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:52 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-1d9b24ed-0cf2-4c3d-b3d7-fab2d08b759e tempest-CreateVolumesFromImageTest-1872899652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:52 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-1d9b24ed-0cf2-4c3d-b3d7-fab2d08b759e tempest-CreateVolumesFromImageTest-1872899652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-1d9b24ed-0cf2-4c3d-b3d7-fab2d08b759e tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1d9b24ed-0cf2-4c3d-b3d7-fab2d08b759e tempest-CreateVolumesFromImageTest-1872899652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:52 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:45:52 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:52 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7c6ef9fd-0fd9-46cc-b39b-a067e8442edb tempest-CreateVolumesFromImageTest-1872899652 None] Acquiring lock "cinder-573de3d5-3469-4b68-ba85-3877e2d8bf3b-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:52 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7c6ef9fd-0fd9-46cc-b39b-a067e8442edb tempest-CreateVolumesFromImageTest-1872899652 None] Lock "cinder-573de3d5-3469-4b68-ba85-3877e2d8bf3b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:52 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7c6ef9fd-0fd9-46cc-b39b-a067e8442edb tempest-CreateVolumesFromImageTest-1872899652 None] Acquiring lock "cinder-quobyte-573de3d5-3469-4b68-ba85-3877e2d8bf3b" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:45:52 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7c6ef9fd-0fd9-46cc-b39b-a067e8442edb tempest-CreateVolumesFromImageTest-1872899652 None] Lock "cinder-quobyte-573de3d5-3469-4b68-ba85-3877e2d8bf3b" acquired by "delete_volume" :: waited 0.019s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:45:52 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[2155e6f2-1b33-4eaf-aff5-630947edcc05]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:45:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7c6ef9fd-0fd9-46cc-b39b-a067e8442edb tempest-CreateVolumesFromImageTest-1872899652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-573de3d5-3469-4b68-ba85-3877e2d8bf3b {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:52 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-573de3d5-3469-4b68-ba85-3877e2d8bf3b Apr 02 12:45:52 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:52 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-1d9b24ed-0cf2-4c3d-b3d7-fab2d08b759e tempest-CreateVolumesFromImageTest-1872899652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.391s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:52 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-1d9b24ed-0cf2-4c3d-b3d7-fab2d08b759e tempest-CreateVolumesFromImageTest-1872899652 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:45:52 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-1d9b24ed-0cf2-4c3d-b3d7-fab2d08b759e tempest-CreateVolumesFromImageTest-1872899652 None] Deleted volume successfully. Apr 02 12:45:52 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-1d9b24ed-0cf2-4c3d-b3d7-fab2d08b759e tempest-CreateVolumesFromImageTest-1872899652 None] Lock "cinder-6261a82d-62da-43b4-92a4-810411fdb961-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:52 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7c6ef9fd-0fd9-46cc-b39b-a067e8442edb tempest-CreateVolumesFromImageTest-1872899652 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-573de3d5-3469-4b68-ba85-3877e2d8bf3b" returned: 0 in 0.432s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7c6ef9fd-0fd9-46cc-b39b-a067e8442edb tempest-CreateVolumesFromImageTest-1872899652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-573de3d5-3469-4b68-ba85-3877e2d8bf3b {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:52 devstack sudo[90227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-573de3d5-3469-4b68-ba85-3877e2d8bf3b Apr 02 12:45:52 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:53 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7c6ef9fd-0fd9-46cc-b39b-a067e8442edb tempest-CreateVolumesFromImageTest-1872899652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-573de3d5-3469-4b68-ba85-3877e2d8bf3b" returned: 0 in 0.360s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:53 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7c6ef9fd-0fd9-46cc-b39b-a067e8442edb tempest-CreateVolumesFromImageTest-1872899652 None] Lock "cinder-quobyte-573de3d5-3469-4b68-ba85-3877e2d8bf3b" released by "delete_volume" :: held 0.817s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:45:53 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-7c6ef9fd-0fd9-46cc-b39b-a067e8442edb tempest-CreateVolumesFromImageTest-1872899652 None] Created reservations ['20cf65da-7ce6-4e6b-9194-45095e678c3f', '56648e4d-6e3b-4bf4-b9c2-46398601a82f', '552623b6-af49-48c9-b6d6-b3218b52780c', '8f2823e5-e147-4ec8-bfdf-937729642760'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:45:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7c6ef9fd-0fd9-46cc-b39b-a067e8442edb tempest-CreateVolumesFromImageTest-1872899652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:45:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7c6ef9fd-0fd9-46cc-b39b-a067e8442edb tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:45:53 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7c6ef9fd-0fd9-46cc-b39b-a067e8442edb tempest-CreateVolumesFromImageTest-1872899652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:45:53 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7c6ef9fd-0fd9-46cc-b39b-a067e8442edb tempest-CreateVolumesFromImageTest-1872899652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:45:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7c6ef9fd-0fd9-46cc-b39b-a067e8442edb tempest-CreateVolumesFromImageTest-1872899652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:45:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7c6ef9fd-0fd9-46cc-b39b-a067e8442edb tempest-CreateVolumesFromImageTest-1872899652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:45:53 devstack sudo[90230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:45:53 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:45:53 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root Apr 02 12:45:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7c6ef9fd-0fd9-46cc-b39b-a067e8442edb tempest-CreateVolumesFromImageTest-1872899652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.426s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:45:53 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-7c6ef9fd-0fd9-46cc-b39b-a067e8442edb tempest-CreateVolumesFromImageTest-1872899652 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:45:53 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-7c6ef9fd-0fd9-46cc-b39b-a067e8442edb tempest-CreateVolumesFromImageTest-1872899652 None] Deleted volume successfully. Apr 02 12:45:53 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7c6ef9fd-0fd9-46cc-b39b-a067e8442edb tempest-CreateVolumesFromImageTest-1872899652 None] Lock "cinder-573de3d5-3469-4b68-ba85-3877e2d8bf3b-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:03 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:SELECT=78,cinder:INSERT=29,cinder:UPDATE=107,cinder:DELETE=8 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:46:07 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Flow 'volume_create_manager' (98d771b1-a68e-4c58-8159-28a4eb02c28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (787f17b7-f807-45ce-ad5f-558d21d1ccfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (787f17b7-f807-45ce-ad5f-558d21d1ccfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1360207160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50e7f0f-6d44-456b-96d8-1001d8fcce4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d78d1b36e4e4dd58131a98b0b135ccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:08Z,use_quota=True,user_id='68161f30d7da4f0e9667fa2433f5ee5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb57b42-6f34-4302-b713-576a717e218c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb57b42-6f34-4302-b713-576a717e218c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1563cdd5-5607-496c-a299-ee8f4de36d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1563cdd5-5607-496c-a299-ee8f4de36d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f50e7f0f-6d44-456b-96d8-1001d8fcce4f', 'volume_name': 'volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c0ab897-b77d-40bd-a52f-282fe14a3b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c0ab897-b77d-40bd-a52f-282fe14a3b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0435a61-a3bc-42ed-98ec-e6ea9cb21a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:08 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Volume f50e7f0f-6d44-456b-96d8-1001d8fcce4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f', 'volume_size': 1} Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1360207160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50e7f0f-6d44-456b-96d8-1001d8fcce4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d78d1b36e4e4dd58131a98b0b135ccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:08Z,use_quota=True,user_id='68161f30d7da4f0e9667fa2433f5ee5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Creating volume f50e7f0f-6d44-456b-96d8-1001d8fcce4f {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:46:08 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:08 devstack sudo[90271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f 1073741824 Apr 02 12:46:08 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:08 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f 1073741824" returned: 0 in 0.435s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:08 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f Apr 02 12:46:08 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:08 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f" returned: 0 in 0.362s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0435a61-a3bc-42ed-98ec-e6ea9cb21a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdeb9db0-b867-4a55-98e6-e907ec841870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:08 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Volume volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f (f50e7f0f-6d44-456b-96d8-1001d8fcce4f): created successfully Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdeb9db0-b867-4a55-98e6-e907ec841870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:08 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Flow 'volume_create_manager' (98d771b1-a68e-4c58-8159-28a4eb02c28d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:08 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-38d2518e-b60c-486b-8bbb-dcdeb628e577 tempest-SnapshotDependencyTests-218966094 None] Created volume successfully. Apr 02 12:46:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d036855b-541a-4cdf-a573-0eea8e807590 tempest-SnapshotDependencyTests-218966094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d036855b-541a-4cdf-a573-0eea8e807590 tempest-SnapshotDependencyTests-218966094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:09 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-d036855b-541a-4cdf-a573-0eea8e807590 tempest-SnapshotDependencyTests-218966094 None] Creating offline snapshot e7d1204a-cf32-4fdd-a2bf-8fd013faf986 of volume f50e7f0f-6d44-456b-96d8-1001d8fcce4f {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:46:09 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f597c09-e804-4ba2-929e-977b892d3752]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:46:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d036855b-541a-4cdf-a573-0eea8e807590 tempest-SnapshotDependencyTests-218966094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:09 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f Apr 02 12:46:09 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:09 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d036855b-541a-4cdf-a573-0eea8e807590 tempest-SnapshotDependencyTests-218966094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f" returned: 0 in 0.432s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d036855b-541a-4cdf-a573-0eea8e807590 tempest-SnapshotDependencyTests-218966094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.e7d1204a-cf32-4fdd-a2bf-8fd013faf986 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:09 devstack sudo[90286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.e7d1204a-cf32-4fdd-a2bf-8fd013faf986 1G Apr 02 12:46:09 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:10 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d036855b-541a-4cdf-a573-0eea8e807590 tempest-SnapshotDependencyTests-218966094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.e7d1204a-cf32-4fdd-a2bf-8fd013faf986 1G" returned: 0 in 0.416s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d036855b-541a-4cdf-a573-0eea8e807590 tempest-SnapshotDependencyTests-218966094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.e7d1204a-cf32-4fdd-a2bf-8fd013faf986 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:10 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.e7d1204a-cf32-4fdd-a2bf-8fd013faf986 Apr 02 12:46:10 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:10 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d036855b-541a-4cdf-a573-0eea8e807590 tempest-SnapshotDependencyTests-218966094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.e7d1204a-cf32-4fdd-a2bf-8fd013faf986" returned: 0 in 0.378s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:10 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-d036855b-541a-4cdf-a573-0eea8e807590 tempest-SnapshotDependencyTests-218966094 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.e7d1204a-cf32-4fdd-a2bf-8fd013faf986 is being set with open permissions: ugo+rw Apr 02 12:46:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d036855b-541a-4cdf-a573-0eea8e807590 tempest-SnapshotDependencyTests-218966094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.e7d1204a-cf32-4fdd-a2bf-8fd013faf986 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:10 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.e7d1204a-cf32-4fdd-a2bf-8fd013faf986 Apr 02 12:46:10 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:10 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d036855b-541a-4cdf-a573-0eea8e807590 tempest-SnapshotDependencyTests-218966094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.e7d1204a-cf32-4fdd-a2bf-8fd013faf986" returned: 0 in 0.363s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d036855b-541a-4cdf-a573-0eea8e807590 tempest-SnapshotDependencyTests-218966094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:10 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.info Apr 02 12:46:10 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:11 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d036855b-541a-4cdf-a573-0eea8e807590 tempest-SnapshotDependencyTests-218966094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.info" returned: 0 in 0.360s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:11 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-d036855b-541a-4cdf-a573-0eea8e807590 tempest-SnapshotDependencyTests-218966094 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.info is being set with open permissions: ugo+rw Apr 02 12:46:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d036855b-541a-4cdf-a573-0eea8e807590 tempest-SnapshotDependencyTests-218966094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:11 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.info Apr 02 12:46:11 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:11 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d036855b-541a-4cdf-a573-0eea8e807590 tempest-SnapshotDependencyTests-218966094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.info" returned: 0 in 0.364s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d036855b-541a-4cdf-a573-0eea8e807590 tempest-SnapshotDependencyTests-218966094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.363s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:11 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-d036855b-541a-4cdf-a573-0eea8e807590 tempest-SnapshotDependencyTests-218966094 None] Create snapshot completed successfully Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Flow 'volume_create_manager' (853b5836-dc52-436e-b859-274c5c348ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d524b5c7-bde4-46a4-8c26-e4b67080b628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d524b5c7-bde4-46a4-8c26-e4b67080b628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69482e1f-5ed8-4472-b296-b1cd3e33dc13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d78d1b36e4e4dd58131a98b0b135ccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e7d1204a-cf32-4fdd-a2bf-8fd013faf986,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:13Z,use_quota=True,user_id='68161f30d7da4f0e9667fa2433f5ee5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b034272-4589-45c7-8e0d-c610a65122ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b034272-4589-45c7-8e0d-c610a65122ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ffaa4d-3c2a-4c82-8230-5ed1a8cc8260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ffaa4d-3c2a-4c82-8230-5ed1a8cc8260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '69482e1f-5ed8-4472-b296-b1cd3e33dc13', 'volume_name': 'volume-69482e1f-5ed8-4472-b296-b1cd3e33dc13', 'volume_size': 1, 'snapshot_id': 'e7d1204a-cf32-4fdd-a2bf-8fd013faf986'}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc41bfe-7e0f-46f3-89f2-8858356fcca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc41bfe-7e0f-46f3-89f2-8858356fcca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269f6950-401d-4027-9147-b50a749fba8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:12 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Volume 69482e1f-5ed8-4472-b296-b1cd3e33dc13: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-69482e1f-5ed8-4472-b296-b1cd3e33dc13', 'volume_size': 1, 'snapshot_id': 'e7d1204a-cf32-4fdd-a2bf-8fd013faf986'} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Acquiring lock "cinder-quobyte-e7d1204a-cf32-4fdd-a2bf-8fd013faf986-69482e1f-5ed8-4472-b296-b1cd3e33dc13" by "_create_volume_from_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Lock "cinder-quobyte-e7d1204a-cf32-4fdd-a2bf-8fd013faf986-69482e1f-5ed8-4472-b296-b1cd3e33dc13" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Creating volume 69482e1f-5ed8-4472-b296-b1cd3e33dc13 from snapshot e7d1204a-cf32-4fdd-a2bf-8fd013faf986 {{(pid=82819) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Acquiring lock "cinder-quobyte-69482e1f-5ed8-4472-b296-b1cd3e33dc13" by "_copy_volume_from_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Lock "cinder-quobyte-69482e1f-5ed8-4472-b296-b1cd3e33dc13" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] snapshot: e7d1204a-cf32-4fdd-a2bf-8fd013faf986, volume: 69482e1f-5ed8-4472-b296-b1cd3e33dc13, {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfe7385-1135-444b-879b-d33efe062d63]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:46:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.e7d1204a-cf32-4fdd-a2bf-8fd013faf986 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:12 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.e7d1204a-cf32-4fdd-a2bf-8fd013faf986 Apr 02 12:46:12 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:13 devstack cinder-volume[82819]: DEBUG oslo_service.periodic_task [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82819) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 12:46:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:13 devstack sudo[90308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:46:13 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:13 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.e7d1204a-cf32-4fdd-a2bf-8fd013faf986" returned: 0 in 0.424s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:46:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 12:46:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Creating direct copy from snapshot {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 12:46:13 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[139831e3-17f0-4689-9d42-2ccc997a74cb]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:46:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:13 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f Apr 02 12:46:13 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:13 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.369s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:13 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:46:13 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f" returned: 0 in 0.432s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:13 devstack cinder-volume[82819]: DEBUG cinder.utils [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Path /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-69482e1f-5ed8-4472-b296-b1cd3e33dc13 not found in is_blk_device check {{(pid=82819) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 12:46:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-69482e1f-5ed8-4472-b296-b1cd3e33dc13 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:13 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-69482e1f-5ed8-4472-b296-b1cd3e33dc13 Apr 02 12:46:13 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:15 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-69482e1f-5ed8-4472-b296-b1cd3e33dc13" returned: 0 in 1.698s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:15 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4d9fcb-7f8b-4d4e-9c5a-19e7c27d2f0a]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:46:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:15 devstack sudo[90331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f Apr 02 12:46:15 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:15 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f" returned: 0 in 0.536s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:15 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f, size 1024.00 MB, duration 1.70 sec, destination /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-69482e1f-5ed8-4472-b296-b1cd3e33dc13 {{(pid=82819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 12:46:15 devstack cinder-volume[82819]: INFO cinder.image.image_utils [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Converted 1024.00 MB image at 602.77 MB/s Apr 02 12:46:15 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-69482e1f-5ed8-4472-b296-b1cd3e33dc13 is being set with open permissions: ugo+rw Apr 02 12:46:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-69482e1f-5ed8-4472-b296-b1cd3e33dc13 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:15 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-69482e1f-5ed8-4472-b296-b1cd3e33dc13 Apr 02 12:46:15 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:16 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-69482e1f-5ed8-4472-b296-b1cd3e33dc13" returned: 0 in 0.354s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Lock "cinder-quobyte-69482e1f-5ed8-4472-b296-b1cd3e33dc13" released by "_copy_volume_from_snapshot" :: held 3.491s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Lock "cinder-quobyte-e7d1204a-cf32-4fdd-a2bf-8fd013faf986-69482e1f-5ed8-4472-b296-b1cd3e33dc13" released by "_create_volume_from_snapshot" :: held 3.507s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.515s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:16 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269f6950-401d-4027-9147-b50a749fba8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69482e1f-5ed8-4472-b296-b1cd3e33dc13', 'volume_size': 1, 'snapshot_id': 'e7d1204a-cf32-4fdd-a2bf-8fd013faf986'}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:16 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b0107f0-d168-4301-8a2a-71f58b9539ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:16 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Volume volume-69482e1f-5ed8-4472-b296-b1cd3e33dc13 (69482e1f-5ed8-4472-b296-b1cd3e33dc13): created successfully Apr 02 12:46:16 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b0107f0-d168-4301-8a2a-71f58b9539ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:16 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Flow 'volume_create_manager' (853b5836-dc52-436e-b859-274c5c348ba0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:16 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-9106953f-ef25-41ce-8ca4-50913734049f tempest-SnapshotDependencyTests-218966094 None] Created volume successfully. Apr 02 12:46:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ad604ff3-0764-4ed8-bea3-01e1c4f00d80 tempest-SnapshotDependencyTests-218966094 None] Acquiring lock "cinder-e7d1204a-cf32-4fdd-a2bf-8fd013faf986-delete_snapshot" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ad604ff3-0764-4ed8-bea3-01e1c4f00d80 tempest-SnapshotDependencyTests-218966094 None] Lock "cinder-e7d1204a-cf32-4fdd-a2bf-8fd013faf986-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ad604ff3-0764-4ed8-bea3-01e1c4f00d80 tempest-SnapshotDependencyTests-218966094 None] Acquiring lock "cinder-quobyte-f50e7f0f-6d44-456b-96d8-1001d8fcce4f" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ad604ff3-0764-4ed8-bea3-01e1c4f00d80 tempest-SnapshotDependencyTests-218966094 None] Lock "cinder-quobyte-f50e7f0f-6d44-456b-96d8-1001d8fcce4f" acquired by "delete_snapshot" :: waited 0.005s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ad604ff3-0764-4ed8-bea3-01e1c4f00d80 tempest-SnapshotDependencyTests-218966094 None] Acquiring lock "cinder-quobyte-e7d1204a-cf32-4fdd-a2bf-8fd013faf986" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:17 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ad604ff3-0764-4ed8-bea3-01e1c4f00d80 tempest-SnapshotDependencyTests-218966094 None] Lock "cinder-quobyte-e7d1204a-cf32-4fdd-a2bf-8fd013faf986" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:17 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-ad604ff3-0764-4ed8-bea3-01e1c4f00d80 tempest-SnapshotDependencyTests-218966094 None] Deleting offline snapshot e7d1204a-cf32-4fdd-a2bf-8fd013faf986 of volume f50e7f0f-6d44-456b-96d8-1001d8fcce4f {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:46:17 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-ad604ff3-0764-4ed8-bea3-01e1c4f00d80 tempest-SnapshotDependencyTests-218966094 None] snapshot_file for this snap is: volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.e7d1204a-cf32-4fdd-a2bf-8fd013faf986 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:46:17 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c45fed-0964-47da-b170-2bafae577911]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:46:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ad604ff3-0764-4ed8-bea3-01e1c4f00d80 tempest-SnapshotDependencyTests-218966094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.e7d1204a-cf32-4fdd-a2bf-8fd013faf986 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:17 devstack sudo[90339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.e7d1204a-cf32-4fdd-a2bf-8fd013faf986 Apr 02 12:46:17 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:17 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ad604ff3-0764-4ed8-bea3-01e1c4f00d80 tempest-SnapshotDependencyTests-218966094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.e7d1204a-cf32-4fdd-a2bf-8fd013faf986" returned: 0 in 0.440s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:17 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-ad604ff3-0764-4ed8-bea3-01e1c4f00d80 tempest-SnapshotDependencyTests-218966094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:46:17 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e348b90-dc98-41ab-b294-22831389badd]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:46:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ad604ff3-0764-4ed8-bea3-01e1c4f00d80 tempest-SnapshotDependencyTests-218966094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:17 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f Apr 02 12:46:17 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:17 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ad604ff3-0764-4ed8-bea3-01e1c4f00d80 tempest-SnapshotDependencyTests-218966094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f" returned: 0 in 0.432s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ad604ff3-0764-4ed8-bea3-01e1c4f00d80 tempest-SnapshotDependencyTests-218966094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.e7d1204a-cf32-4fdd-a2bf-8fd013faf986 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:17 devstack sudo[90350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.e7d1204a-cf32-4fdd-a2bf-8fd013faf986 Apr 02 12:46:17 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:18 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ad604ff3-0764-4ed8-bea3-01e1c4f00d80 tempest-SnapshotDependencyTests-218966094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.e7d1204a-cf32-4fdd-a2bf-8fd013faf986" returned: 0 in 0.407s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ad604ff3-0764-4ed8-bea3-01e1c4f00d80 tempest-SnapshotDependencyTests-218966094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.e7d1204a-cf32-4fdd-a2bf-8fd013faf986 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:18 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.e7d1204a-cf32-4fdd-a2bf-8fd013faf986 Apr 02 12:46:18 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:18 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ad604ff3-0764-4ed8-bea3-01e1c4f00d80 tempest-SnapshotDependencyTests-218966094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f.e7d1204a-cf32-4fdd-a2bf-8fd013faf986" returned: 0 in 0.385s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:18 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:SELECT=94,cinder:INSERT=41,cinder:UPDATE=147,cinder:DELETE=16 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:46:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ad604ff3-0764-4ed8-bea3-01e1c4f00d80 tempest-SnapshotDependencyTests-218966094 None] Lock "cinder-quobyte-e7d1204a-cf32-4fdd-a2bf-8fd013faf986" released by "_delete_snapshot" :: held 1.719s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ad604ff3-0764-4ed8-bea3-01e1c4f00d80 tempest-SnapshotDependencyTests-218966094 None] Lock "cinder-quobyte-f50e7f0f-6d44-456b-96d8-1001d8fcce4f" released by "delete_snapshot" :: held 1.733s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:18 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-ad604ff3-0764-4ed8-bea3-01e1c4f00d80 tempest-SnapshotDependencyTests-218966094 None] Created reservations ['8e7d4904-d9af-41fd-aa36-b6f16430ac20', 'b420b59e-4e27-4481-b6d8-89b4ef88451c', 'a5a2f4d4-1984-4396-928a-41d6738baa69', '4589cae5-d621-476d-a60d-94a8304d7439'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:46:18 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-ad604ff3-0764-4ed8-bea3-01e1c4f00d80 tempest-SnapshotDependencyTests-218966094 None] Delete snapshot completed successfully. Apr 02 12:46:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ad604ff3-0764-4ed8-bea3-01e1c4f00d80 tempest-SnapshotDependencyTests-218966094 None] Lock "cinder-e7d1204a-cf32-4fdd-a2bf-8fd013faf986-delete_snapshot" released by "delete_snapshot" :: held 1.818s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:19 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-534aa6d0-e098-4e68-96aa-b1332174796c tempest-SnapshotDependencyTests-218966094 None] Acquiring lock "cinder-f50e7f0f-6d44-456b-96d8-1001d8fcce4f-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:19 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-534aa6d0-e098-4e68-96aa-b1332174796c tempest-SnapshotDependencyTests-218966094 None] Lock "cinder-f50e7f0f-6d44-456b-96d8-1001d8fcce4f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:19 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-534aa6d0-e098-4e68-96aa-b1332174796c tempest-SnapshotDependencyTests-218966094 None] Acquiring lock "cinder-quobyte-f50e7f0f-6d44-456b-96d8-1001d8fcce4f" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:19 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-534aa6d0-e098-4e68-96aa-b1332174796c tempest-SnapshotDependencyTests-218966094 None] Lock "cinder-quobyte-f50e7f0f-6d44-456b-96d8-1001d8fcce4f" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:19 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[783f0d8a-e838-4e12-857d-051b492492b2]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:46:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-534aa6d0-e098-4e68-96aa-b1332174796c tempest-SnapshotDependencyTests-218966094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:19 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f Apr 02 12:46:19 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:19 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-534aa6d0-e098-4e68-96aa-b1332174796c tempest-SnapshotDependencyTests-218966094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f" returned: 0 in 0.438s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-534aa6d0-e098-4e68-96aa-b1332174796c tempest-SnapshotDependencyTests-218966094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:19 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f Apr 02 12:46:19 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:19 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-534aa6d0-e098-4e68-96aa-b1332174796c tempest-SnapshotDependencyTests-218966094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-f50e7f0f-6d44-456b-96d8-1001d8fcce4f" returned: 0 in 0.365s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:19 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-534aa6d0-e098-4e68-96aa-b1332174796c tempest-SnapshotDependencyTests-218966094 None] Lock "cinder-quobyte-f50e7f0f-6d44-456b-96d8-1001d8fcce4f" released by "delete_volume" :: held 0.839s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:20 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-534aa6d0-e098-4e68-96aa-b1332174796c tempest-SnapshotDependencyTests-218966094 None] Created reservations ['e3f41095-c824-44ca-8d80-320475ea1c85', 'b5db1aea-e760-4a1a-9cd9-41dbc04129cc', '8c7f52a6-041a-4d36-b0bf-31acd63aa737', '75e2520d-9047-4879-8cff-4af527964616'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:46:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-534aa6d0-e098-4e68-96aa-b1332174796c tempest-SnapshotDependencyTests-218966094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-534aa6d0-e098-4e68-96aa-b1332174796c tempest-SnapshotDependencyTests-218966094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:20 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-534aa6d0-e098-4e68-96aa-b1332174796c tempest-SnapshotDependencyTests-218966094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:20 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-534aa6d0-e098-4e68-96aa-b1332174796c tempest-SnapshotDependencyTests-218966094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-534aa6d0-e098-4e68-96aa-b1332174796c tempest-SnapshotDependencyTests-218966094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-534aa6d0-e098-4e68-96aa-b1332174796c tempest-SnapshotDependencyTests-218966094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:20 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:46:20 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:20 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-34de075e-a525-4abf-8977-4355623ba187 tempest-SnapshotDependencyTests-218966094 None] Acquiring lock "cinder-69482e1f-5ed8-4472-b296-b1cd3e33dc13-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:20 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-34de075e-a525-4abf-8977-4355623ba187 tempest-SnapshotDependencyTests-218966094 None] Lock "cinder-69482e1f-5ed8-4472-b296-b1cd3e33dc13-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:20 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-34de075e-a525-4abf-8977-4355623ba187 tempest-SnapshotDependencyTests-218966094 None] Acquiring lock "cinder-quobyte-69482e1f-5ed8-4472-b296-b1cd3e33dc13" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:20 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-34de075e-a525-4abf-8977-4355623ba187 tempest-SnapshotDependencyTests-218966094 None] Lock "cinder-quobyte-69482e1f-5ed8-4472-b296-b1cd3e33dc13" acquired by "delete_volume" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:20 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c069106-cc68-4e2e-a27e-fc776e5139cc]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:46:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-34de075e-a525-4abf-8977-4355623ba187 tempest-SnapshotDependencyTests-218966094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-69482e1f-5ed8-4472-b296-b1cd3e33dc13 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:20 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-69482e1f-5ed8-4472-b296-b1cd3e33dc13 Apr 02 12:46:20 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:20 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-534aa6d0-e098-4e68-96aa-b1332174796c tempest-SnapshotDependencyTests-218966094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.405s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:20 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-534aa6d0-e098-4e68-96aa-b1332174796c tempest-SnapshotDependencyTests-218966094 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:46:20 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-534aa6d0-e098-4e68-96aa-b1332174796c tempest-SnapshotDependencyTests-218966094 None] Deleted volume successfully. Apr 02 12:46:20 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-534aa6d0-e098-4e68-96aa-b1332174796c tempest-SnapshotDependencyTests-218966094 None] Lock "cinder-f50e7f0f-6d44-456b-96d8-1001d8fcce4f-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:20 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-34de075e-a525-4abf-8977-4355623ba187 tempest-SnapshotDependencyTests-218966094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-69482e1f-5ed8-4472-b296-b1cd3e33dc13" returned: 0 in 0.442s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-34de075e-a525-4abf-8977-4355623ba187 tempest-SnapshotDependencyTests-218966094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-69482e1f-5ed8-4472-b296-b1cd3e33dc13 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:20 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-69482e1f-5ed8-4472-b296-b1cd3e33dc13 Apr 02 12:46:20 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:21 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-34de075e-a525-4abf-8977-4355623ba187 tempest-SnapshotDependencyTests-218966094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-69482e1f-5ed8-4472-b296-b1cd3e33dc13" returned: 0 in 0.360s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:21 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-34de075e-a525-4abf-8977-4355623ba187 tempest-SnapshotDependencyTests-218966094 None] Lock "cinder-quobyte-69482e1f-5ed8-4472-b296-b1cd3e33dc13" released by "delete_volume" :: held 0.821s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:21 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-34de075e-a525-4abf-8977-4355623ba187 tempest-SnapshotDependencyTests-218966094 None] Created reservations ['4d99f39b-7211-49f5-90c9-94d2263d7464', 'dad40d0c-66f8-40dd-8fd1-61c4597efb10', '1bc3f9e8-1289-4ead-9441-02de4c114994', '25e497aa-d0b2-41ba-aaa1-6ef3380867d9'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:46:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-34de075e-a525-4abf-8977-4355623ba187 tempest-SnapshotDependencyTests-218966094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-34de075e-a525-4abf-8977-4355623ba187 tempest-SnapshotDependencyTests-218966094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:21 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-34de075e-a525-4abf-8977-4355623ba187 tempest-SnapshotDependencyTests-218966094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:21 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-34de075e-a525-4abf-8977-4355623ba187 tempest-SnapshotDependencyTests-218966094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-34de075e-a525-4abf-8977-4355623ba187 tempest-SnapshotDependencyTests-218966094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-34de075e-a525-4abf-8977-4355623ba187 tempest-SnapshotDependencyTests-218966094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:21 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:46:21 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:21 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-34de075e-a525-4abf-8977-4355623ba187 tempest-SnapshotDependencyTests-218966094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.387s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:21 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-34de075e-a525-4abf-8977-4355623ba187 tempest-SnapshotDependencyTests-218966094 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:46:21 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-34de075e-a525-4abf-8977-4355623ba187 tempest-SnapshotDependencyTests-218966094 None] Deleted volume successfully. Apr 02 12:46:21 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-34de075e-a525-4abf-8977-4355623ba187 tempest-SnapshotDependencyTests-218966094 None] Lock "cinder-69482e1f-5ed8-4472-b296-b1cd3e33dc13-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:31 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:SELECT=15,cinder:INSERT=6,cinder:UPDATE=22,cinder:DELETE=1 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:46:31 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:SELECT=23,cinder:UPDATE=27,cinder:DELETE=3,cinder:INSERT=7 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:46:32 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:46:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Flow 'volume_create_manager' (5e24db95-9442-4ea2-8ccf-20184045c7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c899114-1d41-41d2-9326-2e0b6ac657ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c899114-1d41-41d2-9326-2e0b6ac657ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-752736177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ca941ba-9d06-4d20-a610-9b5be0bf60be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae693f85263e497786be4c9f2184096b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:33Z,use_quota=True,user_id='6efbd1566bd84e31b87325368b605a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033fde20-2841-4183-865c-659afcbfdbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033fde20-2841-4183-865c-659afcbfdbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90787521-8542-475d-9bca-3c8114a9cc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90787521-8542-475d-9bca-3c8114a9cc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ca941ba-9d06-4d20-a610-9b5be0bf60be', 'volume_name': 'volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (429a0650-01e0-4ac5-9792-46d78e661f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (429a0650-01e0-4ac5-9792-46d78e661f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:32 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (654a35d6-1628-4287-ac71-bb99dba2e599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:32 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Volume 9ca941ba-9d06-4d20-a610-9b5be0bf60be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be', 'volume_size': 1} Apr 02 12:46:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-752736177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ca941ba-9d06-4d20-a610-9b5be0bf60be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae693f85263e497786be4c9f2184096b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:33Z,use_quota=True,user_id='6efbd1566bd84e31b87325368b605a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:46:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Creating volume 9ca941ba-9d06-4d20-a610-9b5be0bf60be {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:46:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:46:32 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:46:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:46:33 devstack sudo[90424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be 1073741824 Apr 02 12:46:33 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Flow 'volume_create_manager' (ed340242-3ff9-476f-bcde-4c67d41c6930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3e5477-4a9d-4393-831c-9890b4dc5e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3e5477-4a9d-4393-831c-9890b4dc5e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1237106678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21e345c0-aa34-41f4-a16c-82cae2283e8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='689c79fa2bf74c1ca0f276b8d8ca7e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:33Z,use_quota=True,user_id='a2c21337687840d3ad9bc5542b9b31ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22140e6c-f300-4810-91ea-65f1c8f0b3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22140e6c-f300-4810-91ea-65f1c8f0b3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb5e409-ace6-4eae-a92a-57c2870d4af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb5e409-ace6-4eae-a92a-57c2870d4af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21e345c0-aa34-41f4-a16c-82cae2283e8f', 'volume_name': 'volume-21e345c0-aa34-41f4-a16c-82cae2283e8f', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05bb080-84f5-4a84-8637-0b1b54179eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05bb080-84f5-4a84-8637-0b1b54179eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c8301c-0704-46f4-9e18-9952a0a9c05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Volume 21e345c0-aa34-41f4-a16c-82cae2283e8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21e345c0-aa34-41f4-a16c-82cae2283e8f', 'volume_size': 1} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Flow 'volume_create_manager' (f352899b-66cd-431c-bd77-9045eb3bdb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f12fb4-30b9-4cfb-87ef-26fc0e426b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f12fb4-30b9-4cfb-87ef-26fc0e426b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1962020979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f314b1-0fab-4fd3-804d-fdc639608378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfcfd378f0e84b3189b4d13f31835049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:33Z,use_quota=True,user_id='0290aecc6167462693f17b207a447590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d327f6-f431-4fd6-b3be-d7df94b76f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d327f6-f431-4fd6-b3be-d7df94b76f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd26b1b-6b55-47ba-a681-f99858fb2d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd26b1b-6b55-47ba-a681-f99858fb2d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8f314b1-0fab-4fd3-804d-fdc639608378', 'volume_name': 'volume-e8f314b1-0fab-4fd3-804d-fdc639608378', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73bd2a14-063e-4b45-8550-53f1565b286a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73bd2a14-063e-4b45-8550-53f1565b286a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3de17a-2102-4e92-b1b7-a2c834e3307e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Volume e8f314b1-0fab-4fd3-804d-fdc639608378: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8f314b1-0fab-4fd3-804d-fdc639608378', 'volume_size': 1} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Flow 'volume_create_manager' (3d8ca11c-6fc1-4cf2-86a5-918c46cb0743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6939e5e3-9ce5-42b9-aa1a-3b7fc45f2c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6939e5e3-9ce5-42b9-aa1a-3b7fc45f2c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1293118206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87173a52-4d3a-4a81-8554-59b6518de807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975c27488c9a4392865cb992e3aad350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:33Z,use_quota=True,user_id='a50ac3a288c54616a2af17d6d3829396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247c6f14-9f1c-438e-be83-a396ec206c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247c6f14-9f1c-438e-be83-a396ec206c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (928d1b1e-6362-4f8b-bf8f-b7f9c3398e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (928d1b1e-6362-4f8b-bf8f-b7f9c3398e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87173a52-4d3a-4a81-8554-59b6518de807', 'volume_name': 'volume-87173a52-4d3a-4a81-8554-59b6518de807', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc70963-1132-43fc-bd8a-8bbe7c73d08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc70963-1132-43fc-bd8a-8bbe7c73d08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87fa709-dd44-4ea6-aa48-8c0c299d03dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Volume 87173a52-4d3a-4a81-8554-59b6518de807: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87173a52-4d3a-4a81-8554-59b6518de807', 'volume_size': 1} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Flow 'volume_create_manager' (3e1b4f77-709a-4419-bb57-a82d0d9687b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4284eae3-8208-4ecc-bedb-f526c3bcb10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4284eae3-8208-4ecc-bedb-f526c3bcb10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1023112698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48baf715-0e0f-4dd6-aad5-e92ac16e541e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975c27488c9a4392865cb992e3aad350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:33Z,use_quota=True,user_id='a50ac3a288c54616a2af17d6d3829396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6cd03fb-4242-4d96-977a-b1876ef6ec49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6cd03fb-4242-4d96-977a-b1876ef6ec49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b0c0d8e-2ce5-4f44-aa2d-2d602bc8746a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b0c0d8e-2ce5-4f44-aa2d-2d602bc8746a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48baf715-0e0f-4dd6-aad5-e92ac16e541e', 'volume_name': 'volume-48baf715-0e0f-4dd6-aad5-e92ac16e541e', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be7bf01b-0d24-45c4-876d-345568f48f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be7bf01b-0d24-45c4-876d-345568f48f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf666fd-58cc-4e78-b074-9ee661e8d9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Volume 48baf715-0e0f-4dd6-aad5-e92ac16e541e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48baf715-0e0f-4dd6-aad5-e92ac16e541e', 'volume_size': 1} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:33 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be 1073741824" returned: 0 in 0.580s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:46:33 devstack sudo[90431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be Apr 02 12:46:33 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Flow 'volume_create_manager' (dbb1b74e-3982-4c64-864e-1b4651b9689e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc6ab7b6-18cb-47c2-8097-e07fae49989f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc6ab7b6-18cb-47c2-8097-e07fae49989f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-529883405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=069c54d5-69c5-464e-af5b-0ad772361df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975c27488c9a4392865cb992e3aad350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:34Z,use_quota=True,user_id='a50ac3a288c54616a2af17d6d3829396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa43944-45a3-409f-ba97-2974937a874d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa43944-45a3-409f-ba97-2974937a874d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (397b7c9f-ff9c-48e4-a947-a4c578631165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (397b7c9f-ff9c-48e4-a947-a4c578631165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '069c54d5-69c5-464e-af5b-0ad772361df7', 'volume_name': 'volume-069c54d5-69c5-464e-af5b-0ad772361df7', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (338539fb-be8c-468f-9253-ed47fc3cf8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (338539fb-be8c-468f-9253-ed47fc3cf8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f653e3-e6d1-4ac0-9448-b25ad762c6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Volume 069c54d5-69c5-464e-af5b-0ad772361df7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-069c54d5-69c5-464e-af5b-0ad772361df7', 'volume_size': 1} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Flow 'volume_create_manager' (7b6cb41c-fdef-49d9-8925-98fe209fdf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0617dc-442d-4565-b716-bfbff1d800a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0617dc-442d-4565-b716-bfbff1d800a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1953942086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b347aa21-3aa5-42c5-8522-31e5ff0bb79f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975c27488c9a4392865cb992e3aad350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:34Z,use_quota=True,user_id='a50ac3a288c54616a2af17d6d3829396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f1b5b7-e495-4f18-bb26-6f35460805ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f1b5b7-e495-4f18-bb26-6f35460805ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f818a1d-d3ba-4112-8648-899159a8ab70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f818a1d-d3ba-4112-8648-899159a8ab70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b347aa21-3aa5-42c5-8522-31e5ff0bb79f', 'volume_name': 'volume-b347aa21-3aa5-42c5-8522-31e5ff0bb79f', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302d005f-dca0-4e90-a005-46e438bbc74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302d005f-dca0-4e90-a005-46e438bbc74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b40423f1-6f89-4c7e-a64a-ca617e19171c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Volume b347aa21-3aa5-42c5-8522-31e5ff0bb79f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b347aa21-3aa5-42c5-8522-31e5ff0bb79f', 'volume_size': 1} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Flow 'volume_create_manager' (b570dfcc-1fb7-4178-8c26-6cef28491437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80545062-3449-4233-a5de-a0f96318e718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80545062-3449-4233-a5de-a0f96318e718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1614808027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c8ee6f-4544-4433-a663-859f7849a219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975c27488c9a4392865cb992e3aad350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:34Z,use_quota=True,user_id='a50ac3a288c54616a2af17d6d3829396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2f7138-4cc3-471e-a477-edb77de105d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2f7138-4cc3-471e-a477-edb77de105d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:33 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e7dd8d6-4bc4-457d-9644-f065bf9dec82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e7dd8d6-4bc4-457d-9644-f065bf9dec82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41c8ee6f-4544-4433-a663-859f7849a219', 'volume_name': 'volume-41c8ee6f-4544-4433-a663-859f7849a219', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:34 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ce120ec-9133-4c87-b69d-789a4acf26e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ce120ec-9133-4c87-b69d-789a4acf26e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f6efa7c-2a06-4a06-9991-ec1d1c7f0434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:34 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Volume 41c8ee6f-4544-4433-a663-859f7849a219: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41c8ee6f-4544-4433-a663-859f7849a219', 'volume_size': 1} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be" returned: 0 in 0.421s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.867s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1237106678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21e345c0-aa34-41f4-a16c-82cae2283e8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='689c79fa2bf74c1ca0f276b8d8ca7e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:33Z,use_quota=True,user_id='a2c21337687840d3ad9bc5542b9b31ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Creating volume 21e345c0-aa34-41f4-a16c-82cae2283e8f {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:46:34 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (654a35d6-1628-4287-ac71-bb99dba2e599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:34 devstack sudo[90434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f 1073741824 Apr 02 12:46:34 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e014b3a0-a79b-4123-ace2-4395b2574b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:34 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Volume volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be (9ca941ba-9d06-4d20-a610-9b5be0bf60be): created successfully Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e014b3a0-a79b-4123-ace2-4395b2574b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Flow 'volume_create_manager' (5e24db95-9442-4ea2-8ccf-20184045c7dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:34 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-cd61d895-0a66-4ec6-89af-11eece0c8b0b tempest-VolumeDependencyTests-768920191 None] Created volume successfully. Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-06b25397-fcd6-4697-9891-38b0da727609 tempest-VolumeDependencyTests-768920191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:34 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f 1073741824" returned: 0 in 0.477s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:34 devstack sudo[90439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f Apr 02 12:46:34 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:34 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f" returned: 0 in 0.364s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.626s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1962020979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f314b1-0fab-4fd3-804d-fdc639608378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfcfd378f0e84b3189b4d13f31835049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:33Z,use_quota=True,user_id='0290aecc6167462693f17b207a447590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Creating volume e8f314b1-0fab-4fd3-804d-fdc639608378 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:46:34 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e8f314b1-0fab-4fd3-804d-fdc639608378 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c8301c-0704-46f4-9e18-9952a0a9c05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21e345c0-aa34-41f4-a16c-82cae2283e8f', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:34 devstack sudo[90442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e8f314b1-0fab-4fd3-804d-fdc639608378 1073741824 Apr 02 12:46:34 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf8f2cf-a1fd-4eb5-8fef-6a3c3ec0a49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:34 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Volume volume-21e345c0-aa34-41f4-a16c-82cae2283e8f (21e345c0-aa34-41f4-a16c-82cae2283e8f): created successfully Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf8f2cf-a1fd-4eb5-8fef-6a3c3ec0a49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:34 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Flow 'volume_create_manager' (ed340242-3ff9-476f-bcde-4c67d41c6930) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:34 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-64340cdb-a857-4139-90ef-25b730a4ace3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Created volume successfully. Apr 02 12:46:35 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e8f314b1-0fab-4fd3-804d-fdc639608378 1073741824" returned: 0 in 0.521s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-bcc55c13-d2a9-40ff-bc07-c71f42872190 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e8f314b1-0fab-4fd3-804d-fdc639608378 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:35 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e8f314b1-0fab-4fd3-804d-fdc639608378 Apr 02 12:46:35 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:35 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e8f314b1-0fab-4fd3-804d-fdc639608378" returned: 0 in 0.368s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:35 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:46:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.458s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:35 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1293118206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87173a52-4d3a-4a81-8554-59b6518de807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975c27488c9a4392865cb992e3aad350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:33Z,use_quota=True,user_id='a50ac3a288c54616a2af17d6d3829396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:46:35 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Creating volume 87173a52-4d3a-4a81-8554-59b6518de807 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:46:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:35 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:35 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:35 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:46:35 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:46:35 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-87173a52-4d3a-4a81-8554-59b6518de807 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:35 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-87173a52-4d3a-4a81-8554-59b6518de807 1073741824 Apr 02 12:46:35 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3de17a-2102-4e92-b1b7-a2c834e3307e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8f314b1-0fab-4fd3-804d-fdc639608378', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:35 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:35 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f05a7efa-6699-48e4-a5af-fad550a2661c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:35 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Volume volume-e8f314b1-0fab-4fd3-804d-fdc639608378 (e8f314b1-0fab-4fd3-804d-fdc639608378): created successfully Apr 02 12:46:35 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f05a7efa-6699-48e4-a5af-fad550a2661c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:35 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Flow 'volume_create_manager' (f352899b-66cd-431c-bd77-9045eb3bdb86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:35 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-da82e780-a8cd-4a1c-9b43-e029a6923e15 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Created volume successfully. Apr 02 12:46:36 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-87173a52-4d3a-4a81-8554-59b6518de807 1073741824" returned: 0 in 0.449s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-87173a52-4d3a-4a81-8554-59b6518de807 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:36 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-87173a52-4d3a-4a81-8554-59b6518de807 Apr 02 12:46:36 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Flow 'volume_create_manager' (ad53f0b3-aad9-4be2-8862-1c28a1adf2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13dc17d5-9870-41ad-aa38-fe457c87c9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13dc17d5-9870-41ad-aa38-fe457c87c9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1593423247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a49ef3-32de-479e-9d13-1dbcc125388e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfcfd378f0e84b3189b4d13f31835049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:36Z,use_quota=True,user_id='0290aecc6167462693f17b207a447590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d52212f2-40d9-4f42-951e-04e59ec2acc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d52212f2-40d9-4f42-951e-04e59ec2acc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47363aac-3eea-47cf-b687-2ee5e30f0887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47363aac-3eea-47cf-b687-2ee5e30f0887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24a49ef3-32de-479e-9d13-1dbcc125388e', 'volume_name': 'volume-24a49ef3-32de-479e-9d13-1dbcc125388e', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df9f9b5-16ca-4daf-bc2e-704f6c42d021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df9f9b5-16ca-4daf-bc2e-704f6c42d021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29350db-534d-4176-bd17-4f999df6b24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:36 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Volume 24a49ef3-32de-479e-9d13-1dbcc125388e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24a49ef3-32de-479e-9d13-1dbcc125388e', 'volume_size': 1} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Flow 'volume_create_manager' (00ec9bb5-84ec-4417-bade-8ed0713f25e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (732b68da-44f5-42e6-8890-cf145f64cd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:36 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (732b68da-44f5-42e6-8890-cf145f64cd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2087224091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d49dbed-fa14-4ad3-9b3b-823dead1db64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfcfd378f0e84b3189b4d13f31835049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:37Z,use_quota=True,user_id='0290aecc6167462693f17b207a447590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4058bec-bf67-43af-9d15-537e128252d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4058bec-bf67-43af-9d15-537e128252d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3609d0d2-c2bf-4bc0-aee5-c1e44fa3f0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3609d0d2-c2bf-4bc0-aee5-c1e44fa3f0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d49dbed-fa14-4ad3-9b3b-823dead1db64', 'volume_name': 'volume-4d49dbed-fa14-4ad3-9b3b-823dead1db64', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24916466-5f44-46c5-b0e0-6ae814272d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24916466-5f44-46c5-b0e0-6ae814272d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caeb7fd8-0584-4d87-86a8-021e6a4854d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:36 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Volume 4d49dbed-fa14-4ad3-9b3b-823dead1db64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d49dbed-fa14-4ad3-9b3b-823dead1db64', 'volume_size': 1} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-87173a52-4d3a-4a81-8554-59b6518de807" returned: 0 in 0.448s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.290s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1023112698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48baf715-0e0f-4dd6-aad5-e92ac16e541e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975c27488c9a4392865cb992e3aad350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:33Z,use_quota=True,user_id='a50ac3a288c54616a2af17d6d3829396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Creating volume 48baf715-0e0f-4dd6-aad5-e92ac16e541e {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:46:36 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-48baf715-0e0f-4dd6-aad5-e92ac16e541e 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87fa709-dd44-4ea6-aa48-8c0c299d03dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87173a52-4d3a-4a81-8554-59b6518de807', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:36 devstack sudo[90458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-48baf715-0e0f-4dd6-aad5-e92ac16e541e 1073741824 Apr 02 12:46:36 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f93512ff-107d-46c1-8859-01c2ed6d0790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:36 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Volume volume-87173a52-4d3a-4a81-8554-59b6518de807 (87173a52-4d3a-4a81-8554-59b6518de807): created successfully Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f93512ff-107d-46c1-8859-01c2ed6d0790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Flow 'volume_create_manager' (3d8ca11c-6fc1-4cf2-86a5-918c46cb0743) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:36 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-916e0804-e731-4bd5-bd84-280f14d7a07f tempest-CreateVolumesFromImageTest-552557572 None] Created volume successfully. Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Flow 'volume_create_manager' (0d85520a-32fa-4d82-a7b8-875167d3a64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b488537d-be64-4712-8da8-c4b24f355e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b488537d-be64-4712-8da8-c4b24f355e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-520931408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e650c708-0437-499d-bf10-1c09f9e4c656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfcfd378f0e84b3189b4d13f31835049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:37Z,use_quota=True,user_id='0290aecc6167462693f17b207a447590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (447ac18c-3a69-4f35-a7d2-f078cb2b409f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (447ac18c-3a69-4f35-a7d2-f078cb2b409f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb3800a1-6a07-435a-8f5e-adf6ad256cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb3800a1-6a07-435a-8f5e-adf6ad256cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e650c708-0437-499d-bf10-1c09f9e4c656', 'volume_name': 'volume-e650c708-0437-499d-bf10-1c09f9e4c656', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31b9e7c-1db1-4dd0-b65b-ae55188f5388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31b9e7c-1db1-4dd0-b65b-ae55188f5388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (075ba205-9145-47a1-96eb-f2d832156a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:36 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Volume e650c708-0437-499d-bf10-1c09f9e4c656: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e650c708-0437-499d-bf10-1c09f9e4c656', 'volume_size': 1} Apr 02 12:46:36 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Flow 'volume_create_manager' (e8bddd4d-cb92-41bb-b664-9da9efa5e51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (802044f4-24d4-46e6-bdcf-ee99740a7fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (802044f4-24d4-46e6-bdcf-ee99740a7fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1274481208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11476367-039d-4810-b3c2-b77bf0396370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfcfd378f0e84b3189b4d13f31835049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:37Z,use_quota=True,user_id='0290aecc6167462693f17b207a447590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f23c26ef-292a-4412-8be3-17b79743237e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f23c26ef-292a-4412-8be3-17b79743237e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c133c184-8e4f-4607-87f8-be82a2c605dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c133c184-8e4f-4607-87f8-be82a2c605dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11476367-039d-4810-b3c2-b77bf0396370', 'volume_name': 'volume-11476367-039d-4810-b3c2-b77bf0396370', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0181eb-7f64-4780-9b3e-6c78a3866c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0181eb-7f64-4780-9b3e-6c78a3866c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e69b26d-4867-4604-b6f7-136343415c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:37 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Volume 11476367-039d-4810-b3c2-b77bf0396370: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11476367-039d-4810-b3c2-b77bf0396370', 'volume_size': 1} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Flow 'volume_create_manager' (73017bb7-76b1-4eb1-a63f-b00260f1aa87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:37 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (548df58a-fc57-4504-af91-ccb78149393f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-48baf715-0e0f-4dd6-aad5-e92ac16e541e 1073741824" returned: 0 in 0.550s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (548df58a-fc57-4504-af91-ccb78149393f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-102125025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b881f4c9-21db-4ef8-a4d2-075f84cf7a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfcfd378f0e84b3189b4d13f31835049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:37Z,use_quota=True,user_id='0290aecc6167462693f17b207a447590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1546f058-9d13-441c-b303-2167d8a4b2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1546f058-9d13-441c-b303-2167d8a4b2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74bd7d27-a92f-4218-aecd-cc7bbf571679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74bd7d27-a92f-4218-aecd-cc7bbf571679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b881f4c9-21db-4ef8-a4d2-075f84cf7a01', 'volume_name': 'volume-b881f4c9-21db-4ef8-a4d2-075f84cf7a01', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27176eb6-d4bf-452a-8763-5d414ebbda0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27176eb6-d4bf-452a-8763-5d414ebbda0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b1fe68-2fe6-4b29-9946-72a9f78eb9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:37 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Volume b881f4c9-21db-4ef8-a4d2-075f84cf7a01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b881f4c9-21db-4ef8-a4d2-075f84cf7a01', 'volume_size': 1} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-48baf715-0e0f-4dd6-aad5-e92ac16e541e {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:37 devstack sudo[90463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-48baf715-0e0f-4dd6-aad5-e92ac16e541e Apr 02 12:46:37 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:37 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-48baf715-0e0f-4dd6-aad5-e92ac16e541e" returned: 0 in 0.372s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.050s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-529883405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=069c54d5-69c5-464e-af5b-0ad772361df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975c27488c9a4392865cb992e3aad350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:34Z,use_quota=True,user_id='a50ac3a288c54616a2af17d6d3829396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Creating volume 069c54d5-69c5-464e-af5b-0ad772361df7 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:46:37 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-069c54d5-69c5-464e-af5b-0ad772361df7 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf666fd-58cc-4e78-b074-9ee661e8d9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48baf715-0e0f-4dd6-aad5-e92ac16e541e', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:37 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-069c54d5-69c5-464e-af5b-0ad772361df7 1073741824 Apr 02 12:46:37 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511498e3-a861-469d-b341-779f188b87f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:37 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Volume volume-48baf715-0e0f-4dd6-aad5-e92ac16e541e (48baf715-0e0f-4dd6-aad5-e92ac16e541e): created successfully Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511498e3-a861-469d-b341-779f188b87f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:37 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Flow 'volume_create_manager' (3e1b4f77-709a-4419-bb57-a82d0d9687b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:37 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-c14cc89e-bc94-435f-add3-05882a6a052f tempest-CreateVolumesFromImageTest-552557572 None] Created volume successfully. Apr 02 12:46:38 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-069c54d5-69c5-464e-af5b-0ad772361df7 1073741824" returned: 0 in 0.470s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-069c54d5-69c5-464e-af5b-0ad772361df7 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:38 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-069c54d5-69c5-464e-af5b-0ad772361df7 Apr 02 12:46:38 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:38 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-069c54d5-69c5-464e-af5b-0ad772361df7" returned: 0 in 0.390s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:46:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.759s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1953942086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b347aa21-3aa5-42c5-8522-31e5ff0bb79f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975c27488c9a4392865cb992e3aad350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:34Z,use_quota=True,user_id='a50ac3a288c54616a2af17d6d3829396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:46:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Creating volume b347aa21-3aa5-42c5-8522-31e5ff0bb79f {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:46:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:38 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:46:38 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:46:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b347aa21-3aa5-42c5-8522-31e5ff0bb79f 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f653e3-e6d1-4ac0-9448-b25ad762c6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-069c54d5-69c5-464e-af5b-0ad772361df7', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c877841c-834b-4337-885f-b563c572341e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:38 devstack sudo[90475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b347aa21-3aa5-42c5-8522-31e5ff0bb79f 1073741824 Apr 02 12:46:38 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:38 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Volume volume-069c54d5-69c5-464e-af5b-0ad772361df7 (069c54d5-69c5-464e-af5b-0ad772361df7): created successfully Apr 02 12:46:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c877841c-834b-4337-885f-b563c572341e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:38 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Flow 'volume_create_manager' (dbb1b74e-3982-4c64-864e-1b4651b9689e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:38 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-3f42bbc6-4220-4bdd-bfd0-f848ba691209 tempest-CreateVolumesFromImageTest-552557572 None] Created volume successfully. Apr 02 12:46:39 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b347aa21-3aa5-42c5-8522-31e5ff0bb79f 1073741824" returned: 0 in 0.459s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b347aa21-3aa5-42c5-8522-31e5ff0bb79f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:39 devstack sudo[90480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b347aa21-3aa5-42c5-8522-31e5ff0bb79f Apr 02 12:46:39 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:39 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b347aa21-3aa5-42c5-8522-31e5ff0bb79f" returned: 0 in 0.391s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:39 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:46:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.479s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:39 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1614808027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c8ee6f-4544-4433-a663-859f7849a219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975c27488c9a4392865cb992e3aad350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:34Z,use_quota=True,user_id='a50ac3a288c54616a2af17d6d3829396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:46:39 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Creating volume 41c8ee6f-4544-4433-a663-859f7849a219 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:46:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:39 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:39 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:39 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:46:39 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:46:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-41c8ee6f-4544-4433-a663-859f7849a219 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:39 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b40423f1-6f89-4c7e-a64a-ca617e19171c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b347aa21-3aa5-42c5-8522-31e5ff0bb79f', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:39 devstack sudo[90483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-41c8ee6f-4544-4433-a663-859f7849a219 1073741824 Apr 02 12:46:39 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a30f5e3-f227-4b95-9f5a-0eac36560bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:39 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:39 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Volume volume-b347aa21-3aa5-42c5-8522-31e5ff0bb79f (b347aa21-3aa5-42c5-8522-31e5ff0bb79f): created successfully Apr 02 12:46:39 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a30f5e3-f227-4b95-9f5a-0eac36560bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:39 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Flow 'volume_create_manager' (7b6cb41c-fdef-49d9-8925-98fe209fdf28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:39 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-ea7d0909-6e6e-446f-bece-adea49d23c50 tempest-CreateVolumesFromImageTest-552557572 None] Created volume successfully. Apr 02 12:46:39 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-41c8ee6f-4544-4433-a663-859f7849a219 1073741824" returned: 0 in 0.429s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:39 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-41c8ee6f-4544-4433-a663-859f7849a219 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:39 devstack sudo[90488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-41c8ee6f-4544-4433-a663-859f7849a219 Apr 02 12:46:39 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:40 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-41c8ee6f-4544-4433-a663-859f7849a219" returned: 0 in 0.366s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:40 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:46:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-06b25397-fcd6-4697-9891-38b0da727609 tempest-VolumeDependencyTests-768920191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.040s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:40 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f6efa7c-2a06-4a06-9991-ec1d1c7f0434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41c8ee6f-4544-4433-a663-859f7849a219', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:40 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38c14ad9-417a-4773-b5f8-f1f55ec0c168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:40 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-06b25397-fcd6-4697-9891-38b0da727609 tempest-VolumeDependencyTests-768920191 None] Creating offline snapshot 2f1d3c05-594a-4891-8a55-757adc087308 of volume 9ca941ba-9d06-4d20-a610-9b5be0bf60be {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:46:40 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Volume volume-41c8ee6f-4544-4433-a663-859f7849a219 (41c8ee6f-4544-4433-a663-859f7849a219): created successfully Apr 02 12:46:40 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38c14ad9-417a-4773-b5f8-f1f55ec0c168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:40 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Flow 'volume_create_manager' (b570dfcc-1fb7-4178-8c26-6cef28491437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:40 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[1394bd0c-03c4-43a6-ad39-4dc6b0300d0c]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:46:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-06b25397-fcd6-4697-9891-38b0da727609 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:40 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-ef04a519-47d5-4cef-85bb-6e97414e384f tempest-CreateVolumesFromImageTest-552557572 None] Created volume successfully. Apr 02 12:46:40 devstack sudo[90491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be Apr 02 12:46:40 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:40 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2c64fb9e-c57f-4a3d-9809-0686766f9b8c tempest-CreateVolumesFromImageTest-552557572 None] Acquiring lock "cinder-41c8ee6f-4544-4433-a663-859f7849a219-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:40 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2c64fb9e-c57f-4a3d-9809-0686766f9b8c tempest-CreateVolumesFromImageTest-552557572 None] Lock "cinder-41c8ee6f-4544-4433-a663-859f7849a219-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:40 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2c64fb9e-c57f-4a3d-9809-0686766f9b8c tempest-CreateVolumesFromImageTest-552557572 None] Acquiring lock "cinder-quobyte-41c8ee6f-4544-4433-a663-859f7849a219" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:40 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2c64fb9e-c57f-4a3d-9809-0686766f9b8c tempest-CreateVolumesFromImageTest-552557572 None] Lock "cinder-quobyte-41c8ee6f-4544-4433-a663-859f7849a219" acquired by "delete_volume" :: waited 0.006s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:40 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[3252bca2-5bbe-447b-b623-f6dca52f2982]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:46:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2c64fb9e-c57f-4a3d-9809-0686766f9b8c tempest-CreateVolumesFromImageTest-552557572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-41c8ee6f-4544-4433-a663-859f7849a219 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:40 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-41c8ee6f-4544-4433-a663-859f7849a219 Apr 02 12:46:40 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:40 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-06b25397-fcd6-4697-9891-38b0da727609 tempest-VolumeDependencyTests-768920191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be" returned: 0 in 0.497s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-06b25397-fcd6-4697-9891-38b0da727609 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.2f1d3c05-594a-4891-8a55-757adc087308 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:40 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.2f1d3c05-594a-4891-8a55-757adc087308 1G Apr 02 12:46:40 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:40 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2c64fb9e-c57f-4a3d-9809-0686766f9b8c tempest-CreateVolumesFromImageTest-552557572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-41c8ee6f-4544-4433-a663-859f7849a219" returned: 0 in 0.438s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:40 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2c64fb9e-c57f-4a3d-9809-0686766f9b8c tempest-CreateVolumesFromImageTest-552557572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-41c8ee6f-4544-4433-a663-859f7849a219 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:41 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-41c8ee6f-4544-4433-a663-859f7849a219 Apr 02 12:46:41 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:41 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-06b25397-fcd6-4697-9891-38b0da727609 tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.2f1d3c05-594a-4891-8a55-757adc087308 1G" returned: 0 in 0.456s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-06b25397-fcd6-4697-9891-38b0da727609 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.2f1d3c05-594a-4891-8a55-757adc087308 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:41 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.2f1d3c05-594a-4891-8a55-757adc087308 Apr 02 12:46:41 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:41 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2c64fb9e-c57f-4a3d-9809-0686766f9b8c tempest-CreateVolumesFromImageTest-552557572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-41c8ee6f-4544-4433-a663-859f7849a219" returned: 0 in 0.373s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:41 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2c64fb9e-c57f-4a3d-9809-0686766f9b8c tempest-CreateVolumesFromImageTest-552557572 None] Lock "cinder-quobyte-41c8ee6f-4544-4433-a663-859f7849a219" released by "delete_volume" :: held 0.830s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:41 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-2c64fb9e-c57f-4a3d-9809-0686766f9b8c tempest-CreateVolumesFromImageTest-552557572 None] Created reservations ['feab1cc0-0aa4-4242-bc11-640cdf252265', 'b21acade-cb01-40ad-af2d-20d900179a03', 'a34af6b6-2b00-4ea2-8573-e30723b1fda2', 'ce34ac10-8719-4ddb-bdce-8cb1ccef3082'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:46:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2c64fb9e-c57f-4a3d-9809-0686766f9b8c tempest-CreateVolumesFromImageTest-552557572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2c64fb9e-c57f-4a3d-9809-0686766f9b8c tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:41 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2c64fb9e-c57f-4a3d-9809-0686766f9b8c tempest-CreateVolumesFromImageTest-552557572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:41 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2c64fb9e-c57f-4a3d-9809-0686766f9b8c tempest-CreateVolumesFromImageTest-552557572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2c64fb9e-c57f-4a3d-9809-0686766f9b8c tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2c64fb9e-c57f-4a3d-9809-0686766f9b8c tempest-CreateVolumesFromImageTest-552557572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:41 devstack sudo[90511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:46:41 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:41 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-4b7b5c8a-cfea-46c3-b3e0-7ba636449e30 tempest-CreateVolumesFromImageTest-552557572 None] Acquiring lock "cinder-b347aa21-3aa5-42c5-8522-31e5ff0bb79f-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:41 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-4b7b5c8a-cfea-46c3-b3e0-7ba636449e30 tempest-CreateVolumesFromImageTest-552557572 None] Lock "cinder-b347aa21-3aa5-42c5-8522-31e5ff0bb79f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:41 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-4b7b5c8a-cfea-46c3-b3e0-7ba636449e30 tempest-CreateVolumesFromImageTest-552557572 None] Acquiring lock "cinder-quobyte-b347aa21-3aa5-42c5-8522-31e5ff0bb79f" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:41 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-4b7b5c8a-cfea-46c3-b3e0-7ba636449e30 tempest-CreateVolumesFromImageTest-552557572 None] Lock "cinder-quobyte-b347aa21-3aa5-42c5-8522-31e5ff0bb79f" acquired by "delete_volume" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:41 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a75060-366d-4207-a0ce-25d2cc515996]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:46:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-4b7b5c8a-cfea-46c3-b3e0-7ba636449e30 tempest-CreateVolumesFromImageTest-552557572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b347aa21-3aa5-42c5-8522-31e5ff0bb79f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:41 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-06b25397-fcd6-4697-9891-38b0da727609 tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.2f1d3c05-594a-4891-8a55-757adc087308" returned: 0 in 0.442s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:41 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-06b25397-fcd6-4697-9891-38b0da727609 tempest-VolumeDependencyTests-768920191 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.2f1d3c05-594a-4891-8a55-757adc087308 is being set with open permissions: ugo+rw Apr 02 12:46:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-06b25397-fcd6-4697-9891-38b0da727609 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.2f1d3c05-594a-4891-8a55-757adc087308 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:41 devstack sudo[90522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b347aa21-3aa5-42c5-8522-31e5ff0bb79f Apr 02 12:46:41 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:41 devstack sudo[90523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.2f1d3c05-594a-4891-8a55-757adc087308 Apr 02 12:46:41 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:41 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:41 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2c64fb9e-c57f-4a3d-9809-0686766f9b8c tempest-CreateVolumesFromImageTest-552557572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.404s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:41 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-2c64fb9e-c57f-4a3d-9809-0686766f9b8c tempest-CreateVolumesFromImageTest-552557572 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:46:41 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-2c64fb9e-c57f-4a3d-9809-0686766f9b8c tempest-CreateVolumesFromImageTest-552557572 None] Deleted volume successfully. Apr 02 12:46:41 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2c64fb9e-c57f-4a3d-9809-0686766f9b8c tempest-CreateVolumesFromImageTest-552557572 None] Lock "cinder-41c8ee6f-4544-4433-a663-859f7849a219-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:42 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-06b25397-fcd6-4697-9891-38b0da727609 tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.2f1d3c05-594a-4891-8a55-757adc087308" returned: 0 in 0.363s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-06b25397-fcd6-4697-9891-38b0da727609 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:42 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-4b7b5c8a-cfea-46c3-b3e0-7ba636449e30 tempest-CreateVolumesFromImageTest-552557572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b347aa21-3aa5-42c5-8522-31e5ff0bb79f" returned: 0 in 0.457s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-4b7b5c8a-cfea-46c3-b3e0-7ba636449e30 tempest-CreateVolumesFromImageTest-552557572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b347aa21-3aa5-42c5-8522-31e5ff0bb79f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:42 devstack sudo[90531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.info Apr 02 12:46:42 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:42 devstack sudo[90532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b347aa21-3aa5-42c5-8522-31e5ff0bb79f Apr 02 12:46:42 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:42 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-06b25397-fcd6-4697-9891-38b0da727609 tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.info" returned: 0 in 0.366s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:42 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-06b25397-fcd6-4697-9891-38b0da727609 tempest-VolumeDependencyTests-768920191 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.info is being set with open permissions: ugo+rw Apr 02 12:46:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-06b25397-fcd6-4697-9891-38b0da727609 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:42 devstack sudo[90537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.info Apr 02 12:46:42 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:42 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-4b7b5c8a-cfea-46c3-b3e0-7ba636449e30 tempest-CreateVolumesFromImageTest-552557572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b347aa21-3aa5-42c5-8522-31e5ff0bb79f" returned: 0 in 0.390s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:42 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-4b7b5c8a-cfea-46c3-b3e0-7ba636449e30 tempest-CreateVolumesFromImageTest-552557572 None] Lock "cinder-quobyte-b347aa21-3aa5-42c5-8522-31e5ff0bb79f" released by "delete_volume" :: held 0.872s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:42 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-4b7b5c8a-cfea-46c3-b3e0-7ba636449e30 tempest-CreateVolumesFromImageTest-552557572 None] Created reservations ['36d6f8e2-11bc-4a50-9c9b-4388936bd428', 'cb276727-a6c3-4c33-aae1-0644ada3310f', '40abcd2d-8024-4a6a-a5ab-ae7366d24b10', 'cbe8f6b4-c0db-4c4e-a6ff-da8ebd9d9c29'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:46:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-4b7b5c8a-cfea-46c3-b3e0-7ba636449e30 tempest-CreateVolumesFromImageTest-552557572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-4b7b5c8a-cfea-46c3-b3e0-7ba636449e30 tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:42 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-4b7b5c8a-cfea-46c3-b3e0-7ba636449e30 tempest-CreateVolumesFromImageTest-552557572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:42 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-4b7b5c8a-cfea-46c3-b3e0-7ba636449e30 tempest-CreateVolumesFromImageTest-552557572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-4b7b5c8a-cfea-46c3-b3e0-7ba636449e30 tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-4b7b5c8a-cfea-46c3-b3e0-7ba636449e30 tempest-CreateVolumesFromImageTest-552557572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:42 devstack sudo[90539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:46:42 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:42 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f4e7cd2e-ac9d-44ef-9fb9-414e38e7b664 tempest-CreateVolumesFromImageTest-552557572 None] Acquiring lock "cinder-069c54d5-69c5-464e-af5b-0ad772361df7-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:42 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f4e7cd2e-ac9d-44ef-9fb9-414e38e7b664 tempest-CreateVolumesFromImageTest-552557572 None] Lock "cinder-069c54d5-69c5-464e-af5b-0ad772361df7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:42 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f4e7cd2e-ac9d-44ef-9fb9-414e38e7b664 tempest-CreateVolumesFromImageTest-552557572 None] Acquiring lock "cinder-quobyte-069c54d5-69c5-464e-af5b-0ad772361df7" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:42 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f4e7cd2e-ac9d-44ef-9fb9-414e38e7b664 tempest-CreateVolumesFromImageTest-552557572 None] Lock "cinder-quobyte-069c54d5-69c5-464e-af5b-0ad772361df7" acquired by "delete_volume" :: waited 0.007s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:42 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6dd814-bd9c-4389-a5a9-9eb6b957791b]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:46:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f4e7cd2e-ac9d-44ef-9fb9-414e38e7b664 tempest-CreateVolumesFromImageTest-552557572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-069c54d5-69c5-464e-af5b-0ad772361df7 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:42 devstack sudo[90541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-069c54d5-69c5-464e-af5b-0ad772361df7 Apr 02 12:46:42 devstack sudo[90541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:42 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-06b25397-fcd6-4697-9891-38b0da727609 tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.info" returned: 0 in 0.444s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-06b25397-fcd6-4697-9891-38b0da727609 tempest-VolumeDependencyTests-768920191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.641s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-bcc55c13-d2a9-40ff-bc07-c71f42872190 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.539s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:42 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-06b25397-fcd6-4697-9891-38b0da727609 tempest-VolumeDependencyTests-768920191 None] Create snapshot completed successfully Apr 02 12:46:42 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-bcc55c13-d2a9-40ff-bc07-c71f42872190 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Creating offline snapshot a3db0ed9-f223-4816-be8c-a66508ca6a4a of volume 21e345c0-aa34-41f4-a16c-82cae2283e8f {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:46:42 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a449ca9-abc0-4115-8830-c288c3395dbb]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bcc55c13-d2a9-40ff-bc07-c71f42872190 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:43 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-4b7b5c8a-cfea-46c3-b3e0-7ba636449e30 tempest-CreateVolumesFromImageTest-552557572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.395s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-4b7b5c8a-cfea-46c3-b3e0-7ba636449e30 tempest-CreateVolumesFromImageTest-552557572 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:46:43 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-4b7b5c8a-cfea-46c3-b3e0-7ba636449e30 tempest-CreateVolumesFromImageTest-552557572 None] Deleted volume successfully. Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-4b7b5c8a-cfea-46c3-b3e0-7ba636449e30 tempest-CreateVolumesFromImageTest-552557572 None] Lock "cinder-b347aa21-3aa5-42c5-8522-31e5ff0bb79f-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:43 devstack sudo[90545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f Apr 02 12:46:43 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:43 devstack sudo[90541]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f4e7cd2e-ac9d-44ef-9fb9-414e38e7b664 tempest-CreateVolumesFromImageTest-552557572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-069c54d5-69c5-464e-af5b-0ad772361df7" returned: 0 in 0.453s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f4e7cd2e-ac9d-44ef-9fb9-414e38e7b664 tempest-CreateVolumesFromImageTest-552557572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-069c54d5-69c5-464e-af5b-0ad772361df7 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:43 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-069c54d5-69c5-464e-af5b-0ad772361df7 Apr 02 12:46:43 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:43 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bcc55c13-d2a9-40ff-bc07-c71f42872190 tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f" returned: 0 in 0.430s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bcc55c13-d2a9-40ff-bc07-c71f42872190 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f.a3db0ed9-f223-4816-be8c-a66508ca6a4a 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:43 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f.a3db0ed9-f223-4816-be8c-a66508ca6a4a 1G Apr 02 12:46:43 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:43 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f4e7cd2e-ac9d-44ef-9fb9-414e38e7b664 tempest-CreateVolumesFromImageTest-552557572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-069c54d5-69c5-464e-af5b-0ad772361df7" returned: 0 in 0.393s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f4e7cd2e-ac9d-44ef-9fb9-414e38e7b664 tempest-CreateVolumesFromImageTest-552557572 None] Lock "cinder-quobyte-069c54d5-69c5-464e-af5b-0ad772361df7" released by "delete_volume" :: held 0.886s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-f4e7cd2e-ac9d-44ef-9fb9-414e38e7b664 tempest-CreateVolumesFromImageTest-552557572 None] Created reservations ['cf9469e2-3d86-42e0-b52c-74ce6115c114', '8109cbe6-1e1b-4811-921d-749eb2bfd05e', '2594e4f2-8ef5-4bc1-a245-36e37eabd3ef', 'c2ba3811-f891-42fa-a77c-33d45d545e6b'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-f4e7cd2e-ac9d-44ef-9fb9-414e38e7b664 tempest-CreateVolumesFromImageTest-552557572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-f4e7cd2e-ac9d-44ef-9fb9-414e38e7b664 tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-f4e7cd2e-ac9d-44ef-9fb9-414e38e7b664 tempest-CreateVolumesFromImageTest-552557572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-f4e7cd2e-ac9d-44ef-9fb9-414e38e7b664 tempest-CreateVolumesFromImageTest-552557572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-f4e7cd2e-ac9d-44ef-9fb9-414e38e7b664 tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f4e7cd2e-ac9d-44ef-9fb9-414e38e7b664 tempest-CreateVolumesFromImageTest-552557572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:43 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:46:43 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7a95f47a-9c81-4743-b5b6-da66386855ac tempest-CreateVolumesFromImageTest-552557572 None] Acquiring lock "cinder-48baf715-0e0f-4dd6-aad5-e92ac16e541e-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7a95f47a-9c81-4743-b5b6-da66386855ac tempest-CreateVolumesFromImageTest-552557572 None] Lock "cinder-48baf715-0e0f-4dd6-aad5-e92ac16e541e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:46:43 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7a95f47a-9c81-4743-b5b6-da66386855ac tempest-CreateVolumesFromImageTest-552557572 None] Acquiring lock "cinder-quobyte-48baf715-0e0f-4dd6-aad5-e92ac16e541e" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Flow 'volume_create_manager' (92eb2c55-d04d-48b5-9d7c-a91647f33467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59c31181-ab28-467d-a5b6-86cf907cfcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bcc55c13-d2a9-40ff-bc07-c71f42872190 tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f.a3db0ed9-f223-4816-be8c-a66508ca6a4a 1G" returned: 0 in 0.541s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59c31181-ab28-467d-a5b6-86cf907cfcf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-451921465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba61afe2-58e2-41dd-85e5-61e62a0637ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae693f85263e497786be4c9f2184096b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2f1d3c05-594a-4891-8a55-757adc087308,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:44Z,use_quota=True,user_id='6efbd1566bd84e31b87325368b605a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (453db3be-05ec-4f34-a030-81821c15fa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (453db3be-05ec-4f34-a030-81821c15fa96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891546d6-e45e-4d80-bd63-3a18f426d178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891546d6-e45e-4d80-bd63-3a18f426d178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ba61afe2-58e2-41dd-85e5-61e62a0637ee', 'volume_name': 'volume-ba61afe2-58e2-41dd-85e5-61e62a0637ee', 'volume_size': 1, 'snapshot_id': '2f1d3c05-594a-4891-8a55-757adc087308'}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3059565b-f781-430d-b924-409e18336636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:43 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3059565b-f781-430d-b924-409e18336636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:44 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e681f6a5-3dbc-4080-a192-838f7bc46141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:44 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Volume ba61afe2-58e2-41dd-85e5-61e62a0637ee: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ba61afe2-58e2-41dd-85e5-61e62a0637ee', 'volume_size': 1, 'snapshot_id': '2f1d3c05-594a-4891-8a55-757adc087308'} Apr 02 12:46:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bcc55c13-d2a9-40ff-bc07-c71f42872190 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21e345c0-aa34-41f4-a16c-82cae2283e8f -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f.a3db0ed9-f223-4816-be8c-a66508ca6a4a {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7a95f47a-9c81-4743-b5b6-da66386855ac tempest-CreateVolumesFromImageTest-552557572 None] Lock "cinder-quobyte-48baf715-0e0f-4dd6-aad5-e92ac16e541e" acquired by "delete_volume" :: waited 0.085s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:44 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21e345c0-aa34-41f4-a16c-82cae2283e8f -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f.a3db0ed9-f223-4816-be8c-a66508ca6a4a Apr 02 12:46:44 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:44 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3885597-3717-4398-b386-67f1100fb7fa]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:46:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7a95f47a-9c81-4743-b5b6-da66386855ac tempest-CreateVolumesFromImageTest-552557572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-48baf715-0e0f-4dd6-aad5-e92ac16e541e {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:44 devstack sudo[90565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-48baf715-0e0f-4dd6-aad5-e92ac16e541e Apr 02 12:46:44 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:44 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-f4e7cd2e-ac9d-44ef-9fb9-414e38e7b664 tempest-CreateVolumesFromImageTest-552557572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.456s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:44 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-f4e7cd2e-ac9d-44ef-9fb9-414e38e7b664 tempest-CreateVolumesFromImageTest-552557572 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:46:44 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-f4e7cd2e-ac9d-44ef-9fb9-414e38e7b664 tempest-CreateVolumesFromImageTest-552557572 None] Deleted volume successfully. Apr 02 12:46:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-f4e7cd2e-ac9d-44ef-9fb9-414e38e7b664 tempest-CreateVolumesFromImageTest-552557572 None] Lock "cinder-069c54d5-69c5-464e-af5b-0ad772361df7-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:44 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bcc55c13-d2a9-40ff-bc07-c71f42872190 tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21e345c0-aa34-41f4-a16c-82cae2283e8f -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f.a3db0ed9-f223-4816-be8c-a66508ca6a4a" returned: 0 in 0.399s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:44 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-bcc55c13-d2a9-40ff-bc07-c71f42872190 tempest-CreateVolumesFromSnapshotTest-1385949222 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f.a3db0ed9-f223-4816-be8c-a66508ca6a4a is being set with open permissions: ugo+rw Apr 02 12:46:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bcc55c13-d2a9-40ff-bc07-c71f42872190 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f.a3db0ed9-f223-4816-be8c-a66508ca6a4a {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:44 devstack sudo[90573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f.a3db0ed9-f223-4816-be8c-a66508ca6a4a Apr 02 12:46:44 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:44 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7a95f47a-9c81-4743-b5b6-da66386855ac tempest-CreateVolumesFromImageTest-552557572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-48baf715-0e0f-4dd6-aad5-e92ac16e541e" returned: 0 in 0.443s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7a95f47a-9c81-4743-b5b6-da66386855ac tempest-CreateVolumesFromImageTest-552557572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-48baf715-0e0f-4dd6-aad5-e92ac16e541e {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:44 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-48baf715-0e0f-4dd6-aad5-e92ac16e541e Apr 02 12:46:44 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:44 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bcc55c13-d2a9-40ff-bc07-c71f42872190 tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f.a3db0ed9-f223-4816-be8c-a66508ca6a4a" returned: 0 in 0.385s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bcc55c13-d2a9-40ff-bc07-c71f42872190 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:44 devstack sudo[90580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f.info Apr 02 12:46:44 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:44 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7a95f47a-9c81-4743-b5b6-da66386855ac tempest-CreateVolumesFromImageTest-552557572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-48baf715-0e0f-4dd6-aad5-e92ac16e541e" returned: 0 in 0.377s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:44 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7a95f47a-9c81-4743-b5b6-da66386855ac tempest-CreateVolumesFromImageTest-552557572 None] Lock "cinder-quobyte-48baf715-0e0f-4dd6-aad5-e92ac16e541e" released by "delete_volume" :: held 0.844s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:44 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-7a95f47a-9c81-4743-b5b6-da66386855ac tempest-CreateVolumesFromImageTest-552557572 None] Created reservations ['809bb62d-a8a0-46b1-acec-332d5208c672', 'b1dc95b7-40e8-466b-9857-4e44f7b7be4b', '46dc1f20-2d40-40a8-a9b9-af2d4f6da3e1', 'af2499db-540c-4505-8927-86944053425d'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:46:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7a95f47a-9c81-4743-b5b6-da66386855ac tempest-CreateVolumesFromImageTest-552557572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7a95f47a-9c81-4743-b5b6-da66386855ac tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:44 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7a95f47a-9c81-4743-b5b6-da66386855ac tempest-CreateVolumesFromImageTest-552557572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:44 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-7a95f47a-9c81-4743-b5b6-da66386855ac tempest-CreateVolumesFromImageTest-552557572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-7a95f47a-9c81-4743-b5b6-da66386855ac tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:44 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7a95f47a-9c81-4743-b5b6-da66386855ac tempest-CreateVolumesFromImageTest-552557572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:44 devstack sudo[90582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:46:44 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-520f75d2-2423-42bb-a670-b562bfe5eb29 tempest-CreateVolumesFromImageTest-552557572 None] Acquiring lock "cinder-87173a52-4d3a-4a81-8554-59b6518de807-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-520f75d2-2423-42bb-a670-b562bfe5eb29 tempest-CreateVolumesFromImageTest-552557572 None] Lock "cinder-87173a52-4d3a-4a81-8554-59b6518de807-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-520f75d2-2423-42bb-a670-b562bfe5eb29 tempest-CreateVolumesFromImageTest-552557572 None] Acquiring lock "cinder-quobyte-87173a52-4d3a-4a81-8554-59b6518de807" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-520f75d2-2423-42bb-a670-b562bfe5eb29 tempest-CreateVolumesFromImageTest-552557572 None] Lock "cinder-quobyte-87173a52-4d3a-4a81-8554-59b6518de807" acquired by "delete_volume" :: waited 0.006s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60f80e4-4adb-4fae-96d5-254c40a6ed04]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-520f75d2-2423-42bb-a670-b562bfe5eb29 tempest-CreateVolumesFromImageTest-552557572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-87173a52-4d3a-4a81-8554-59b6518de807 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:45 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-87173a52-4d3a-4a81-8554-59b6518de807 Apr 02 12:46:45 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:45 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bcc55c13-d2a9-40ff-bc07-c71f42872190 tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f.info" returned: 0 in 0.387s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:45 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-bcc55c13-d2a9-40ff-bc07-c71f42872190 tempest-CreateVolumesFromSnapshotTest-1385949222 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f.info is being set with open permissions: ugo+rw Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bcc55c13-d2a9-40ff-bc07-c71f42872190 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:45 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f.info Apr 02 12:46:45 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:45 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-7a95f47a-9c81-4743-b5b6-da66386855ac tempest-CreateVolumesFromImageTest-552557572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.420s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-7a95f47a-9c81-4743-b5b6-da66386855ac tempest-CreateVolumesFromImageTest-552557572 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:46:45 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-7a95f47a-9c81-4743-b5b6-da66386855ac tempest-CreateVolumesFromImageTest-552557572 None] Deleted volume successfully. Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-7a95f47a-9c81-4743-b5b6-da66386855ac tempest-CreateVolumesFromImageTest-552557572 None] Lock "cinder-48baf715-0e0f-4dd6-aad5-e92ac16e541e-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:45 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-520f75d2-2423-42bb-a670-b562bfe5eb29 tempest-CreateVolumesFromImageTest-552557572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-87173a52-4d3a-4a81-8554-59b6518de807" returned: 0 in 0.431s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-520f75d2-2423-42bb-a670-b562bfe5eb29 tempest-CreateVolumesFromImageTest-552557572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-87173a52-4d3a-4a81-8554-59b6518de807 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:45 devstack sudo[90593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-87173a52-4d3a-4a81-8554-59b6518de807 Apr 02 12:46:45 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:45 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-bcc55c13-d2a9-40ff-bc07-c71f42872190 tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f.info" returned: 0 in 0.398s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-bcc55c13-d2a9-40ff-bc07-c71f42872190 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.645s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.072s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1593423247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a49ef3-32de-479e-9d13-1dbcc125388e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfcfd378f0e84b3189b4d13f31835049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:36Z,use_quota=True,user_id='0290aecc6167462693f17b207a447590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Creating volume 24a49ef3-32de-479e-9d13-1dbcc125388e {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:46:45 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-24a49ef3-32de-479e-9d13-1dbcc125388e 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:45 devstack sudo[90596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-24a49ef3-32de-479e-9d13-1dbcc125388e 1073741824 Apr 02 12:46:45 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:45 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-bcc55c13-d2a9-40ff-bc07-c71f42872190 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Create snapshot completed successfully Apr 02 12:46:45 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-520f75d2-2423-42bb-a670-b562bfe5eb29 tempest-CreateVolumesFromImageTest-552557572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-87173a52-4d3a-4a81-8554-59b6518de807" returned: 0 in 0.397s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-520f75d2-2423-42bb-a670-b562bfe5eb29 tempest-CreateVolumesFromImageTest-552557572 None] Lock "cinder-quobyte-87173a52-4d3a-4a81-8554-59b6518de807" released by "delete_volume" :: held 0.851s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-520f75d2-2423-42bb-a670-b562bfe5eb29 tempest-CreateVolumesFromImageTest-552557572 None] Created reservations ['be2e2e27-cc77-4048-8a5a-eb0084c4df52', 'b407175a-a2e0-47bd-8900-fd9ee820d7bc', '99eadc49-7014-4c0b-863e-6983ef1405a8', '006a09cb-37fa-4acf-a2b1-adcd68744985'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-520f75d2-2423-42bb-a670-b562bfe5eb29 tempest-CreateVolumesFromImageTest-552557572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-520f75d2-2423-42bb-a670-b562bfe5eb29 tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-520f75d2-2423-42bb-a670-b562bfe5eb29 tempest-CreateVolumesFromImageTest-552557572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-520f75d2-2423-42bb-a670-b562bfe5eb29 tempest-CreateVolumesFromImageTest-552557572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-520f75d2-2423-42bb-a670-b562bfe5eb29 tempest-CreateVolumesFromImageTest-552557572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:45 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-520f75d2-2423-42bb-a670-b562bfe5eb29 tempest-CreateVolumesFromImageTest-552557572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:45 devstack sudo[90602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:46:45 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:46 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-24a49ef3-32de-479e-9d13-1dbcc125388e 1073741824" returned: 0 in 0.485s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-24a49ef3-32de-479e-9d13-1dbcc125388e {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:46 devstack sudo[90604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-24a49ef3-32de-479e-9d13-1dbcc125388e Apr 02 12:46:46 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:46 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-520f75d2-2423-42bb-a670-b562bfe5eb29 tempest-CreateVolumesFromImageTest-552557572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.439s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:46 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-520f75d2-2423-42bb-a670-b562bfe5eb29 tempest-CreateVolumesFromImageTest-552557572 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:46:46 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-520f75d2-2423-42bb-a670-b562bfe5eb29 tempest-CreateVolumesFromImageTest-552557572 None] Deleted volume successfully. Apr 02 12:46:46 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-520f75d2-2423-42bb-a670-b562bfe5eb29 tempest-CreateVolumesFromImageTest-552557572 None] Lock "cinder-87173a52-4d3a-4a81-8554-59b6518de807-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:46 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-24a49ef3-32de-479e-9d13-1dbcc125388e" returned: 0 in 0.475s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:46 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:46:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.879s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:46 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2087224091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d49dbed-fa14-4ad3-9b3b-823dead1db64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfcfd378f0e84b3189b4d13f31835049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:37Z,use_quota=True,user_id='0290aecc6167462693f17b207a447590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:46:46 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Creating volume 4d49dbed-fa14-4ad3-9b3b-823dead1db64 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:46:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:46 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:46 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:46 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:46:46 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:46:46 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-4d49dbed-fa14-4ad3-9b3b-823dead1db64 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:46 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29350db-534d-4176-bd17-4f999df6b24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24a49ef3-32de-479e-9d13-1dbcc125388e', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:46 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f0cc414-c3e5-4d6c-b967-0b1f3d511654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:46 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-4d49dbed-fa14-4ad3-9b3b-823dead1db64 1073741824 Apr 02 12:46:46 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:46 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Volume volume-24a49ef3-32de-479e-9d13-1dbcc125388e (24a49ef3-32de-479e-9d13-1dbcc125388e): created successfully Apr 02 12:46:46 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f0cc414-c3e5-4d6c-b967-0b1f3d511654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:46 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Flow 'volume_create_manager' (ad53f0b3-aad9-4be2-8862-1c28a1adf2d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:46 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-3aae22bc-5869-46a9-960d-4eb70b1393d5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Created volume successfully. Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Flow 'volume_create_manager' (e85b192a-0738-4ee1-ad78-bd4e5c37c689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc951558-4916-414a-bd22-dac4445a0ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc951558-4916-414a-bd22-dac4445a0ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-359325255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1981ae70-d84e-49dc-8ee5-964360194915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='689c79fa2bf74c1ca0f276b8d8ca7e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:47Z,use_quota=True,user_id='a2c21337687840d3ad9bc5542b9b31ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db6ad4ae-9b9e-4b8b-bc20-4ee201c2b4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db6ad4ae-9b9e-4b8b-bc20-4ee201c2b4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc4c5a4-e5d1-4bb8-a477-505d4789a04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc4c5a4-e5d1-4bb8-a477-505d4789a04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1981ae70-d84e-49dc-8ee5-964360194915', 'volume_name': 'volume-1981ae70-d84e-49dc-8ee5-964360194915', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a34e04b-2b5c-4dd6-adb7-c99cf43a5d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a34e04b-2b5c-4dd6-adb7-c99cf43a5d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef7ac422-6298-4e66-9bc2-9d81a5e83624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:47 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Volume 1981ae70-d84e-49dc-8ee5-964360194915: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1981ae70-d84e-49dc-8ee5-964360194915', 'volume_size': 1} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:47 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-4d49dbed-fa14-4ad3-9b3b-823dead1db64 1073741824" returned: 0 in 0.575s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-4d49dbed-fa14-4ad3-9b3b-823dead1db64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:47 devstack sudo[90614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-4d49dbed-fa14-4ad3-9b3b-823dead1db64 Apr 02 12:46:47 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Flow 'volume_create_manager' (2f083037-644c-4815-b328-4da90fc902fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (276036f8-4728-4507-a87a-a324f2cf0cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (276036f8-4728-4507-a87a-a324f2cf0cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-715108104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a662bb38-789f-47b1-a5f3-b82baf41bf8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='689c79fa2bf74c1ca0f276b8d8ca7e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:47Z,use_quota=True,user_id='a2c21337687840d3ad9bc5542b9b31ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f213209f-f37e-4000-a9b8-0b67cc52c93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f213209f-f37e-4000-a9b8-0b67cc52c93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d48fbc74-d258-4d2f-adf1-05d6ecb797df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d48fbc74-d258-4d2f-adf1-05d6ecb797df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a662bb38-789f-47b1-a5f3-b82baf41bf8a', 'volume_name': 'volume-a662bb38-789f-47b1-a5f3-b82baf41bf8a', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f6fa64-173a-4c7d-a665-550caf5713c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f6fa64-173a-4c7d-a665-550caf5713c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad6c7de-098c-4a45-9193-53c3c6033c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:47 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Volume a662bb38-789f-47b1-a5f3-b82baf41bf8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a662bb38-789f-47b1-a5f3-b82baf41bf8a', 'volume_size': 1} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Flow 'volume_create_manager' (eea9e426-fcc7-4380-b18e-5924fe7681cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3aab957-9002-493b-bbff-64a6fd9679fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3aab957-9002-493b-bbff-64a6fd9679fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-715328149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bef1b4b-5145-47db-aafa-fbe6d45755cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='689c79fa2bf74c1ca0f276b8d8ca7e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:47Z,use_quota=True,user_id='a2c21337687840d3ad9bc5542b9b31ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc622a0c-399f-4f91-8e9a-a8c6284ba09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc622a0c-399f-4f91-8e9a-a8c6284ba09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60fdaa5-8d8b-489f-8b08-6ed84baae54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60fdaa5-8d8b-489f-8b08-6ed84baae54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bef1b4b-5145-47db-aafa-fbe6d45755cb', 'volume_name': 'volume-0bef1b4b-5145-47db-aafa-fbe6d45755cb', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c5f9e22-a6b6-4ab7-95a2-f151262882ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c5f9e22-a6b6-4ab7-95a2-f151262882ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e4b8d8-e135-42a9-a9eb-d1365feb9b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:47 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Volume 0bef1b4b-5145-47db-aafa-fbe6d45755cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bef1b4b-5145-47db-aafa-fbe6d45755cb', 'volume_size': 1} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Flow 'volume_create_manager' (3f349cd2-2331-4cb1-8fe8-b75d3fc300f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f52cf62-2945-4aea-aaf0-fa80bd7e3386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f52cf62-2945-4aea-aaf0-fa80bd7e3386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-221038484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3abaf445-3c75-4512-a41b-415296c3a495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='689c79fa2bf74c1ca0f276b8d8ca7e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:48Z,use_quota=True,user_id='a2c21337687840d3ad9bc5542b9b31ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (883d83df-6465-43f0-8538-8307c497ae4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (883d83df-6465-43f0-8538-8307c497ae4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6060d77-cf00-46f7-a033-a6555081de06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6060d77-cf00-46f7-a033-a6555081de06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3abaf445-3c75-4512-a41b-415296c3a495', 'volume_name': 'volume-3abaf445-3c75-4512-a41b-415296c3a495', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc32b253-f123-4803-be06-01af521f7c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc32b253-f123-4803-be06-01af521f7c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76058120-47b3-4aaf-b9fb-8c7db90ed218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:47 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Volume 3abaf445-3c75-4512-a41b-415296c3a495: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3abaf445-3c75-4512-a41b-415296c3a495', 'volume_size': 1} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:47 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-4d49dbed-fa14-4ad3-9b3b-823dead1db64" returned: 0 in 0.572s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.854s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-520931408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e650c708-0437-499d-bf10-1c09f9e4c656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfcfd378f0e84b3189b4d13f31835049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:37Z,use_quota=True,user_id='0290aecc6167462693f17b207a447590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Creating volume e650c708-0437-499d-bf10-1c09f9e4c656 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:46:47 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e650c708-0437-499d-bf10-1c09f9e4c656 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caeb7fd8-0584-4d87-86a8-021e6a4854d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d49dbed-fa14-4ad3-9b3b-823dead1db64', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304ef3fd-54b3-48eb-992a-15e308f5da73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:47 devstack sudo[90618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e650c708-0437-499d-bf10-1c09f9e4c656 1073741824 Apr 02 12:46:47 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:47 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Volume volume-4d49dbed-fa14-4ad3-9b3b-823dead1db64 (4d49dbed-fa14-4ad3-9b3b-823dead1db64): created successfully Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304ef3fd-54b3-48eb-992a-15e308f5da73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Flow 'volume_create_manager' (00ec9bb5-84ec-4417-bade-8ed0713f25e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:47 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-e577432a-4aa8-4a9d-8733-d0634c6f0191 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Created volume successfully. Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Flow 'volume_create_manager' (490e7656-969f-44b8-a48a-58e751b6f600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c285931-0efc-46c2-89a7-66123ec2fec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c285931-0efc-46c2-89a7-66123ec2fec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1621788592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf0ebd6-299f-4f61-b497-c471b464ae23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='689c79fa2bf74c1ca0f276b8d8ca7e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:48Z,use_quota=True,user_id='a2c21337687840d3ad9bc5542b9b31ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe76bb5b-f3de-4f83-b888-2e3046c112ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe76bb5b-f3de-4f83-b888-2e3046c112ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:47 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79776b85-1341-4475-8c39-f001a3c79e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79776b85-1341-4475-8c39-f001a3c79e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbf0ebd6-299f-4f61-b497-c471b464ae23', 'volume_name': 'volume-dbf0ebd6-299f-4f61-b497-c471b464ae23', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a826d4e9-0b5c-4e95-9ecf-79cbe401b0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a826d4e9-0b5c-4e95-9ecf-79cbe401b0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23b2c414-1e3c-44f0-a3f8-c65d47e16a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:48 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Volume dbf0ebd6-299f-4f61-b497-c471b464ae23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbf0ebd6-299f-4f61-b497-c471b464ae23', 'volume_size': 1} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Flow 'volume_create_manager' (18c36561-902d-4bdc-a306-8c4c502e6c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5741ef-dada-4647-89a9-a8f29b9a038c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5741ef-dada-4647-89a9-a8f29b9a038c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67767d6b-d9ab-4a59-b27a-617c699b7147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300719e6d60e4e418c7edc921fc1acdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:48Z,use_quota=True,user_id='02f73e7e43e7445798114fab218164ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f29de3f-e950-433a-a5d4-f2e6acd3a434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f29de3f-e950-433a-a5d4-f2e6acd3a434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a3eb04f-78cb-4d03-86ed-a1e1e1a882e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a3eb04f-78cb-4d03-86ed-a1e1e1a882e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67767d6b-d9ab-4a59-b27a-617c699b7147', 'volume_name': 'volume-67767d6b-d9ab-4a59-b27a-617c699b7147', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f1a370-60e6-40ee-abc1-2eb00ff6be22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f1a370-60e6-40ee-abc1-2eb00ff6be22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3556f4c3-798c-4c8a-ab3f-a00dec633c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:48 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Volume 67767d6b-d9ab-4a59-b27a-617c699b7147: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67767d6b-d9ab-4a59-b27a-617c699b7147', 'volume_size': 1} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:48 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e650c708-0437-499d-bf10-1c09f9e4c656 1073741824" returned: 0 in 0.515s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e650c708-0437-499d-bf10-1c09f9e4c656 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:48 devstack sudo[90623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e650c708-0437-499d-bf10-1c09f9e4c656 Apr 02 12:46:48 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:48 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e650c708-0437-499d-bf10-1c09f9e4c656" returned: 0 in 0.366s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.596s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1274481208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11476367-039d-4810-b3c2-b77bf0396370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfcfd378f0e84b3189b4d13f31835049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:37Z,use_quota=True,user_id='0290aecc6167462693f17b207a447590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Creating volume 11476367-039d-4810-b3c2-b77bf0396370 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:46:48 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-11476367-039d-4810-b3c2-b77bf0396370 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (075ba205-9145-47a1-96eb-f2d832156a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e650c708-0437-499d-bf10-1c09f9e4c656', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:48 devstack sudo[90626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-11476367-039d-4810-b3c2-b77bf0396370 1073741824 Apr 02 12:46:48 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b08618e1-9f43-487e-a816-fa742797b0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:48 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Volume volume-e650c708-0437-499d-bf10-1c09f9e4c656 (e650c708-0437-499d-bf10-1c09f9e4c656): created successfully Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b08618e1-9f43-487e-a816-fa742797b0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:48 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Flow 'volume_create_manager' (0d85520a-32fa-4d82-a7b8-875167d3a64c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:48 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-c404620d-4a29-49d8-b7b0-7bfb10e9024c tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Created volume successfully. Apr 02 12:46:49 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-11476367-039d-4810-b3c2-b77bf0396370 1073741824" returned: 0 in 0.515s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-11476367-039d-4810-b3c2-b77bf0396370 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:49 devstack sudo[90631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-11476367-039d-4810-b3c2-b77bf0396370 Apr 02 12:46:49 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:49 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-11476367-039d-4810-b3c2-b77bf0396370" returned: 0 in 0.386s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:49 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:46:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.321s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:49 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-102125025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b881f4c9-21db-4ef8-a4d2-075f84cf7a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfcfd378f0e84b3189b4d13f31835049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:37Z,use_quota=True,user_id='0290aecc6167462693f17b207a447590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:46:49 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Creating volume b881f4c9-21db-4ef8-a4d2-075f84cf7a01 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:46:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:49 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:49 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:49 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:46:49 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:46:49 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b881f4c9-21db-4ef8-a4d2-075f84cf7a01 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:49 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e69b26d-4867-4604-b6f7-136343415c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11476367-039d-4810-b3c2-b77bf0396370', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:49 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87617b7-72cb-443b-b585-fa2058a04817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:49 devstack sudo[90634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b881f4c9-21db-4ef8-a4d2-075f84cf7a01 1073741824 Apr 02 12:46:49 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:49 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Volume volume-11476367-039d-4810-b3c2-b77bf0396370 (11476367-039d-4810-b3c2-b77bf0396370): created successfully Apr 02 12:46:49 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87617b7-72cb-443b-b585-fa2058a04817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:49 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Flow 'volume_create_manager' (e8bddd4d-cb92-41bb-b664-9da9efa5e51e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:49 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-cb21f36b-ab97-49a8-a5b4-151d73a4c688 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Created volume successfully. Apr 02 12:46:50 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b881f4c9-21db-4ef8-a4d2-075f84cf7a01 1073741824" returned: 0 in 0.484s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b881f4c9-21db-4ef8-a4d2-075f84cf7a01 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:50 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b881f4c9-21db-4ef8-a4d2-075f84cf7a01 Apr 02 12:46:50 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:50 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b881f4c9-21db-4ef8-a4d2-075f84cf7a01" returned: 0 in 0.400s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.544s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Acquiring lock "cinder-quobyte-2f1d3c05-594a-4891-8a55-757adc087308-ba61afe2-58e2-41dd-85e5-61e62a0637ee" by "_create_volume_from_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b1fe68-2fe6-4b29-9946-72a9f78eb9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b881f4c9-21db-4ef8-a4d2-075f84cf7a01', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e39f417f-9c95-46f4-8b5f-82e16c77fbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:50 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Volume volume-b881f4c9-21db-4ef8-a4d2-075f84cf7a01 (b881f4c9-21db-4ef8-a4d2-075f84cf7a01): created successfully Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e39f417f-9c95-46f4-8b5f-82e16c77fbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Flow 'volume_create_manager' (73017bb7-76b1-4eb1-a63f-b00260f1aa87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Lock "cinder-quobyte-2f1d3c05-594a-4891-8a55-757adc087308-ba61afe2-58e2-41dd-85e5-61e62a0637ee" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Creating volume ba61afe2-58e2-41dd-85e5-61e62a0637ee from snapshot 2f1d3c05-594a-4891-8a55-757adc087308 {{(pid=82819) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Acquiring lock "cinder-quobyte-ba61afe2-58e2-41dd-85e5-61e62a0637ee" by "_copy_volume_from_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:50 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-34b047a7-5464-452e-82ad-3851ca40e668 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Created volume successfully. Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Lock "cinder-quobyte-ba61afe2-58e2-41dd-85e5-61e62a0637ee" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] snapshot: 2f1d3c05-594a-4891-8a55-757adc087308, volume: ba61afe2-58e2-41dd-85e5-61e62a0637ee, {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[a131f57f-e30e-4b27-babd-1764ef7fb1f6]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:46:50 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.2f1d3c05-594a-4891-8a55-757adc087308 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:50 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.2f1d3c05-594a-4891-8a55-757adc087308 Apr 02 12:46:50 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:51 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.2f1d3c05-594a-4891-8a55-757adc087308" returned: 0 in 0.474s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:51 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:46:51 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 12:46:51 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Creating direct copy from snapshot {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 12:46:51 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fce2d8-dbe4-4580-8790-709861f85d31]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:46:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-8ac7c8bb-3b79-4c3f-967e-df80b495ec86 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "cinder-b881f4c9-21db-4ef8-a4d2-075f84cf7a01-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-8ac7c8bb-3b79-4c3f-967e-df80b495ec86 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "cinder-b881f4c9-21db-4ef8-a4d2-075f84cf7a01-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:51 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be Apr 02 12:46:51 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-8ac7c8bb-3b79-4c3f-967e-df80b495ec86 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "cinder-quobyte-b881f4c9-21db-4ef8-a4d2-075f84cf7a01" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:51 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-8ac7c8bb-3b79-4c3f-967e-df80b495ec86 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "cinder-quobyte-b881f4c9-21db-4ef8-a4d2-075f84cf7a01" acquired by "delete_volume" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:51 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdeabcc0-8bbb-4239-a1ee-2ec531524588]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:46:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8ac7c8bb-3b79-4c3f-967e-df80b495ec86 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b881f4c9-21db-4ef8-a4d2-075f84cf7a01 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:51 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b881f4c9-21db-4ef8-a4d2-075f84cf7a01 Apr 02 12:46:51 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:51 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be" returned: 0 in 0.480s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:51 devstack cinder-volume[82819]: DEBUG cinder.utils [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Path /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ba61afe2-58e2-41dd-85e5-61e62a0637ee not found in is_blk_device check {{(pid=82819) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 12:46:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ba61afe2-58e2-41dd-85e5-61e62a0637ee {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:51 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ba61afe2-58e2-41dd-85e5-61e62a0637ee Apr 02 12:46:51 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:51 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8ac7c8bb-3b79-4c3f-967e-df80b495ec86 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b881f4c9-21db-4ef8-a4d2-075f84cf7a01" returned: 0 in 0.454s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:51 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8ac7c8bb-3b79-4c3f-967e-df80b495ec86 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b881f4c9-21db-4ef8-a4d2-075f84cf7a01 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:51 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b881f4c9-21db-4ef8-a4d2-075f84cf7a01 Apr 02 12:46:51 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:52 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8ac7c8bb-3b79-4c3f-967e-df80b495ec86 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-b881f4c9-21db-4ef8-a4d2-075f84cf7a01" returned: 0 in 0.557s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:52 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-8ac7c8bb-3b79-4c3f-967e-df80b495ec86 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "cinder-quobyte-b881f4c9-21db-4ef8-a4d2-075f84cf7a01" released by "delete_volume" :: held 1.047s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:52 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-8ac7c8bb-3b79-4c3f-967e-df80b495ec86 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Created reservations ['e73e155e-4166-4633-a979-28e489da7e7e', '84b1ab05-98d6-4be1-bda6-5df4bf69b8f4', 'a6490886-b622-4d65-9e64-4f0c934dbc1c', 'bbe2cc94-6e9e-469e-b1b3-d41e6ec440e3'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:46:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-8ac7c8bb-3b79-4c3f-967e-df80b495ec86 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-8ac7c8bb-3b79-4c3f-967e-df80b495ec86 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:52 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-8ac7c8bb-3b79-4c3f-967e-df80b495ec86 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:52 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-8ac7c8bb-3b79-4c3f-967e-df80b495ec86 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-8ac7c8bb-3b79-4c3f-967e-df80b495ec86 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:52 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8ac7c8bb-3b79-4c3f-967e-df80b495ec86 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:52 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:46:52 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:53 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ba20f605-0b5b-4fe7-8924-a3f8185cf3a5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "cinder-11476367-039d-4810-b3c2-b77bf0396370-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:53 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ba20f605-0b5b-4fe7-8924-a3f8185cf3a5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "cinder-11476367-039d-4810-b3c2-b77bf0396370-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:53 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8ac7c8bb-3b79-4c3f-967e-df80b495ec86 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 1.178s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:53 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-8ac7c8bb-3b79-4c3f-967e-df80b495ec86 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:46:53 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-8ac7c8bb-3b79-4c3f-967e-df80b495ec86 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Deleted volume successfully. Apr 02 12:46:53 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ba20f605-0b5b-4fe7-8924-a3f8185cf3a5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "cinder-quobyte-11476367-039d-4810-b3c2-b77bf0396370" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:53 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-8ac7c8bb-3b79-4c3f-967e-df80b495ec86 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "cinder-b881f4c9-21db-4ef8-a4d2-075f84cf7a01-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:53 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ba20f605-0b5b-4fe7-8924-a3f8185cf3a5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "cinder-quobyte-11476367-039d-4810-b3c2-b77bf0396370" acquired by "delete_volume" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:53 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef035df-ff9e-4582-985f-7101f19343f7]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:46:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ba20f605-0b5b-4fe7-8924-a3f8185cf3a5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-11476367-039d-4810-b3c2-b77bf0396370 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:53 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:53 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-11476367-039d-4810-b3c2-b77bf0396370 Apr 02 12:46:53 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ba61afe2-58e2-41dd-85e5-61e62a0637ee" returned: 0 in 2.194s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:53 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf79efc-178f-4451-b029-86911e286da3]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:46:53 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:53 devstack sudo[90677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be Apr 02 12:46:53 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:54 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ba20f605-0b5b-4fe7-8924-a3f8185cf3a5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-11476367-039d-4810-b3c2-b77bf0396370" returned: 0 in 0.445s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ba20f605-0b5b-4fe7-8924-a3f8185cf3a5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-11476367-039d-4810-b3c2-b77bf0396370 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:54 devstack sudo[90684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-11476367-039d-4810-b3c2-b77bf0396370 Apr 02 12:46:54 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:54 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be" returned: 0 in 0.592s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be, size 1024.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ba61afe2-58e2-41dd-85e5-61e62a0637ee {{(pid=82819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 12:46:54 devstack cinder-volume[82819]: INFO cinder.image.image_utils [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Converted 1024.00 MB image at 466.50 MB/s Apr 02 12:46:54 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ba61afe2-58e2-41dd-85e5-61e62a0637ee is being set with open permissions: ugo+rw Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ba61afe2-58e2-41dd-85e5-61e62a0637ee {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:54 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ba61afe2-58e2-41dd-85e5-61e62a0637ee Apr 02 12:46:54 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:54 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ba20f605-0b5b-4fe7-8924-a3f8185cf3a5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-11476367-039d-4810-b3c2-b77bf0396370" returned: 0 in 0.411s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ba20f605-0b5b-4fe7-8924-a3f8185cf3a5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "cinder-quobyte-11476367-039d-4810-b3c2-b77bf0396370" released by "delete_volume" :: held 0.883s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-ba20f605-0b5b-4fe7-8924-a3f8185cf3a5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Created reservations ['e6e2e095-5c72-42ba-a369-dac39cf99cd5', '22cd0c2c-7087-4b49-a6e1-e1cac46907e2', 'cbcc6887-30c6-4f62-8af1-86ece42ec8c1', 'bf0a82ef-24e4-46d9-bded-f45b1f8e3f8b'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ba20f605-0b5b-4fe7-8924-a3f8185cf3a5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ba20f605-0b5b-4fe7-8924-a3f8185cf3a5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ba20f605-0b5b-4fe7-8924-a3f8185cf3a5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ba20f605-0b5b-4fe7-8924-a3f8185cf3a5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ba20f605-0b5b-4fe7-8924-a3f8185cf3a5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ba20f605-0b5b-4fe7-8924-a3f8185cf3a5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:54 devstack sudo[90690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:46:54 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ef697712-7083-480c-b745-60cd3e03c73a tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "cinder-e650c708-0437-499d-bf10-1c09f9e4c656-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ef697712-7083-480c-b745-60cd3e03c73a tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "cinder-e650c708-0437-499d-bf10-1c09f9e4c656-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:54 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ba61afe2-58e2-41dd-85e5-61e62a0637ee" returned: 0 in 0.401s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Lock "cinder-quobyte-ba61afe2-58e2-41dd-85e5-61e62a0637ee" released by "_copy_volume_from_snapshot" :: held 4.220s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Lock "cinder-quobyte-2f1d3c05-594a-4891-8a55-757adc087308-ba61afe2-58e2-41dd-85e5-61e62a0637ee" released by "_create_volume_from_snapshot" :: held 4.244s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.277s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.737s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-359325255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1981ae70-d84e-49dc-8ee5-964360194915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='689c79fa2bf74c1ca0f276b8d8ca7e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:47Z,use_quota=True,user_id='a2c21337687840d3ad9bc5542b9b31ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Creating volume 1981ae70-d84e-49dc-8ee5-964360194915 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:46:54 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1981ae70-d84e-49dc-8ee5-964360194915 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:54 devstack sudo[90693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1981ae70-d84e-49dc-8ee5-964360194915 1073741824 Apr 02 12:46:54 devstack sudo[90693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e681f6a5-3dbc-4080-a192-838f7bc46141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba61afe2-58e2-41dd-85e5-61e62a0637ee', 'volume_size': 1, 'snapshot_id': '2f1d3c05-594a-4891-8a55-757adc087308'}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63a1b02-5026-4090-aee7-ea1e80ef945f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ef697712-7083-480c-b745-60cd3e03c73a tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "cinder-quobyte-e650c708-0437-499d-bf10-1c09f9e4c656" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:54 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Volume volume-ba61afe2-58e2-41dd-85e5-61e62a0637ee (ba61afe2-58e2-41dd-85e5-61e62a0637ee): created successfully Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63a1b02-5026-4090-aee7-ea1e80ef945f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Flow 'volume_create_manager' (92eb2c55-d04d-48b5-9d7c-a91647f33467) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ef697712-7083-480c-b745-60cd3e03c73a tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "cinder-quobyte-e650c708-0437-499d-bf10-1c09f9e4c656" acquired by "delete_volume" :: waited 0.017s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4458f5-0570-4336-8f24-7b24c75ddbf7]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:46:54 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ef697712-7083-480c-b745-60cd3e03c73a tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e650c708-0437-499d-bf10-1c09f9e4c656 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:54 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-cb8a5f7f-57ff-4d43-8f7e-ea5efc9c7b4e tempest-VolumeDependencyTests-768920191 None] Created volume successfully. Apr 02 12:46:55 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e650c708-0437-499d-bf10-1c09f9e4c656 Apr 02 12:46:55 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:55 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ba20f605-0b5b-4fe7-8924-a3f8185cf3a5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.413s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-ba20f605-0b5b-4fe7-8924-a3f8185cf3a5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:46:55 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-ba20f605-0b5b-4fe7-8924-a3f8185cf3a5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Deleted volume successfully. Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ba20f605-0b5b-4fe7-8924-a3f8185cf3a5 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "cinder-11476367-039d-4810-b3c2-b77bf0396370-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:55 devstack sudo[90693]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1981ae70-d84e-49dc-8ee5-964360194915 1073741824" returned: 0 in 0.483s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1981ae70-d84e-49dc-8ee5-964360194915 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:55 devstack sudo[90704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1981ae70-d84e-49dc-8ee5-964360194915 Apr 02 12:46:55 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:55 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ef697712-7083-480c-b745-60cd3e03c73a tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e650c708-0437-499d-bf10-1c09f9e4c656" returned: 0 in 0.511s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ef697712-7083-480c-b745-60cd3e03c73a tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e650c708-0437-499d-bf10-1c09f9e4c656 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:55 devstack sudo[90706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e650c708-0437-499d-bf10-1c09f9e4c656 Apr 02 12:46:55 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:55 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1981ae70-d84e-49dc-8ee5-964360194915" returned: 0 in 0.411s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.464s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-715108104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a662bb38-789f-47b1-a5f3-b82baf41bf8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='689c79fa2bf74c1ca0f276b8d8ca7e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:47Z,use_quota=True,user_id='a2c21337687840d3ad9bc5542b9b31ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Creating volume a662bb38-789f-47b1-a5f3-b82baf41bf8a {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:46:55 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a662bb38-789f-47b1-a5f3-b82baf41bf8a 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6e961ec9-529d-42c8-a103-3542a5c49362 tempest-VolumeDependencyTests-768920191 None] Acquiring lock "cinder-2f1d3c05-594a-4891-8a55-757adc087308-delete_snapshot" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:55 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a662bb38-789f-47b1-a5f3-b82baf41bf8a 1073741824 Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef7ac422-6298-4e66-9bc2-9d81a5e83624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1981ae70-d84e-49dc-8ee5-964360194915', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:55 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e39eb8b4-32b7-486b-b089-63b8ede19adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6e961ec9-529d-42c8-a103-3542a5c49362 tempest-VolumeDependencyTests-768920191 None] Lock "cinder-2f1d3c05-594a-4891-8a55-757adc087308-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6e961ec9-529d-42c8-a103-3542a5c49362 tempest-VolumeDependencyTests-768920191 None] Acquiring lock "cinder-quobyte-9ca941ba-9d06-4d20-a610-9b5be0bf60be" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:55 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Volume volume-1981ae70-d84e-49dc-8ee5-964360194915 (1981ae70-d84e-49dc-8ee5-964360194915): created successfully Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e39eb8b4-32b7-486b-b089-63b8ede19adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Flow 'volume_create_manager' (e85b192a-0738-4ee1-ad78-bd4e5c37c689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6e961ec9-529d-42c8-a103-3542a5c49362 tempest-VolumeDependencyTests-768920191 None] Lock "cinder-quobyte-9ca941ba-9d06-4d20-a610-9b5be0bf60be" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6e961ec9-529d-42c8-a103-3542a5c49362 tempest-VolumeDependencyTests-768920191 None] Acquiring lock "cinder-quobyte-2f1d3c05-594a-4891-8a55-757adc087308" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:55 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:55 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-a785e95b-b78c-4f37-b0a8-d58e10ebd426 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Created volume successfully. Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ef697712-7083-480c-b745-60cd3e03c73a tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e650c708-0437-499d-bf10-1c09f9e4c656" returned: 0 in 0.412s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6e961ec9-529d-42c8-a103-3542a5c49362 tempest-VolumeDependencyTests-768920191 None] Lock "cinder-quobyte-2f1d3c05-594a-4891-8a55-757adc087308" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-6e961ec9-529d-42c8-a103-3542a5c49362 tempest-VolumeDependencyTests-768920191 None] Deleting offline snapshot 2f1d3c05-594a-4891-8a55-757adc087308 of volume 9ca941ba-9d06-4d20-a610-9b5be0bf60be {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-6e961ec9-529d-42c8-a103-3542a5c49362 tempest-VolumeDependencyTests-768920191 None] snapshot_file for this snap is: volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.2f1d3c05-594a-4891-8a55-757adc087308 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ef697712-7083-480c-b745-60cd3e03c73a tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "cinder-quobyte-e650c708-0437-499d-bf10-1c09f9e4c656" released by "delete_volume" :: held 0.959s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a476bff-c85e-414d-a91d-ba72e826a305]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6e961ec9-529d-42c8-a103-3542a5c49362 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.2f1d3c05-594a-4891-8a55-757adc087308 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-ef697712-7083-480c-b745-60cd3e03c73a tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Created reservations ['6117e476-5ed5-4d6f-a158-1fa409bb3c96', '868e00c7-24fb-498d-a544-c7d6236ceef3', '78a3f1ca-eec0-4f08-b1bd-c05f84eac6e0', '04a8644f-5c79-4569-bc1e-7b3c0b1095e2'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:46:55 devstack sudo[90712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.2f1d3c05-594a-4891-8a55-757adc087308 Apr 02 12:46:55 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ef697712-7083-480c-b745-60cd3e03c73a tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ef697712-7083-480c-b745-60cd3e03c73a tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ef697712-7083-480c-b745-60cd3e03c73a tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ef697712-7083-480c-b745-60cd3e03c73a tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ef697712-7083-480c-b745-60cd3e03c73a tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:55 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ef697712-7083-480c-b745-60cd3e03c73a tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:56 devstack sudo[90714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:46:56 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:56 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a662bb38-789f-47b1-a5f3-b82baf41bf8a 1073741824" returned: 0 in 0.473s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a662bb38-789f-47b1-a5f3-b82baf41bf8a {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:56 devstack sudo[90720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a662bb38-789f-47b1-a5f3-b82baf41bf8a Apr 02 12:46:56 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:56 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6e961ec9-529d-42c8-a103-3542a5c49362 tempest-VolumeDependencyTests-768920191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.2f1d3c05-594a-4891-8a55-757adc087308" returned: 0 in 0.484s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-6e961ec9-529d-42c8-a103-3542a5c49362 tempest-VolumeDependencyTests-768920191 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb78ed83-2c37-4662-a5ec-7922e606cd15]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6e961ec9-529d-42c8-a103-3542a5c49362 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:56 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ef697712-7083-480c-b745-60cd3e03c73a tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.417s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-ef697712-7083-480c-b745-60cd3e03c73a tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:46:56 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-ef697712-7083-480c-b745-60cd3e03c73a tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Deleted volume successfully. Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-ef697712-7083-480c-b745-60cd3e03c73a tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "cinder-e650c708-0437-499d-bf10-1c09f9e4c656-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:56 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be Apr 02 12:46:56 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:56 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a662bb38-789f-47b1-a5f3-b82baf41bf8a" returned: 0 in 0.416s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.109s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-715328149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bef1b4b-5145-47db-aafa-fbe6d45755cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='689c79fa2bf74c1ca0f276b8d8ca7e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:47Z,use_quota=True,user_id='a2c21337687840d3ad9bc5542b9b31ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Creating volume 0bef1b4b-5145-47db-aafa-fbe6d45755cb {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:46:56 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0bef1b4b-5145-47db-aafa-fbe6d45755cb 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad6c7de-098c-4a45-9193-53c3c6033c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a662bb38-789f-47b1-a5f3-b82baf41bf8a', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:56 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0bef1b4b-5145-47db-aafa-fbe6d45755cb 1073741824 Apr 02 12:46:56 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (250fe333-50b6-4c78-926a-62431b51200c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:56 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Volume volume-a662bb38-789f-47b1-a5f3-b82baf41bf8a (a662bb38-789f-47b1-a5f3-b82baf41bf8a): created successfully Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (250fe333-50b6-4c78-926a-62431b51200c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Flow 'volume_create_manager' (2f083037-644c-4815-b328-4da90fc902fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:56 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-9b804f25-f152-4a98-913b-1baf8d01e305 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Created volume successfully. Apr 02 12:46:56 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6e961ec9-529d-42c8-a103-3542a5c49362 tempest-VolumeDependencyTests-768920191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be" returned: 0 in 0.567s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6e961ec9-529d-42c8-a103-3542a5c49362 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.2f1d3c05-594a-4891-8a55-757adc087308 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:56 devstack sudo[90765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.2f1d3c05-594a-4891-8a55-757adc087308 Apr 02 12:46:56 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:56 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-41e42d8c-8419-4adf-b238-90c12c749f72 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "cinder-4d49dbed-fa14-4ad3-9b3b-823dead1db64-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-41e42d8c-8419-4adf-b238-90c12c749f72 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "cinder-4d49dbed-fa14-4ad3-9b3b-823dead1db64-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-41e42d8c-8419-4adf-b238-90c12c749f72 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "cinder-quobyte-4d49dbed-fa14-4ad3-9b3b-823dead1db64" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-41e42d8c-8419-4adf-b238-90c12c749f72 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "cinder-quobyte-4d49dbed-fa14-4ad3-9b3b-823dead1db64" acquired by "delete_volume" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[055e4e8a-4f38-4742-830e-ace25298fbb0]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-41e42d8c-8419-4adf-b238-90c12c749f72 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-4d49dbed-fa14-4ad3-9b3b-823dead1db64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:57 devstack sudo[90769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-4d49dbed-fa14-4ad3-9b3b-823dead1db64 Apr 02 12:46:57 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:57 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0bef1b4b-5145-47db-aafa-fbe6d45755cb 1073741824" returned: 0 in 0.519s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0bef1b4b-5145-47db-aafa-fbe6d45755cb {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:57 devstack sudo[90774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0bef1b4b-5145-47db-aafa-fbe6d45755cb Apr 02 12:46:57 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:57 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6e961ec9-529d-42c8-a103-3542a5c49362 tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.2f1d3c05-594a-4891-8a55-757adc087308" returned: 0 in 0.514s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6e961ec9-529d-42c8-a103-3542a5c49362 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.2f1d3c05-594a-4891-8a55-757adc087308 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:57 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.2f1d3c05-594a-4891-8a55-757adc087308 Apr 02 12:46:57 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:57 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-41e42d8c-8419-4adf-b238-90c12c749f72 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-4d49dbed-fa14-4ad3-9b3b-823dead1db64" returned: 0 in 0.451s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-41e42d8c-8419-4adf-b238-90c12c749f72 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-4d49dbed-fa14-4ad3-9b3b-823dead1db64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:57 devstack sudo[90784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-4d49dbed-fa14-4ad3-9b3b-823dead1db64 Apr 02 12:46:57 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:57 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0bef1b4b-5145-47db-aafa-fbe6d45755cb" returned: 0 in 0.460s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.990s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-221038484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3abaf445-3c75-4512-a41b-415296c3a495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='689c79fa2bf74c1ca0f276b8d8ca7e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:48Z,use_quota=True,user_id='a2c21337687840d3ad9bc5542b9b31ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Creating volume 3abaf445-3c75-4512-a41b-415296c3a495 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:46:57 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3abaf445-3c75-4512-a41b-415296c3a495 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e4b8d8-e135-42a9-a9eb-d1365feb9b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bef1b4b-5145-47db-aafa-fbe6d45755cb', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57600c9-bb5d-4915-ada4-7ee4ebd581af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:57 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3abaf445-3c75-4512-a41b-415296c3a495 1073741824 Apr 02 12:46:57 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Volume volume-0bef1b4b-5145-47db-aafa-fbe6d45755cb (0bef1b4b-5145-47db-aafa-fbe6d45755cb): created successfully Apr 02 12:46:57 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57600c9-bb5d-4915-ada4-7ee4ebd581af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Flow 'volume_create_manager' (eea9e426-fcc7-4380-b18e-5924fe7681cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:57 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-2e431a79-75b8-4a11-b24b-d3afff25f64a tempest-CreateVolumesFromSnapshotTest-1385949222 None] Created volume successfully. Apr 02 12:46:57 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-41e42d8c-8419-4adf-b238-90c12c749f72 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-4d49dbed-fa14-4ad3-9b3b-823dead1db64" returned: 0 in 0.381s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-41e42d8c-8419-4adf-b238-90c12c749f72 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "cinder-quobyte-4d49dbed-fa14-4ad3-9b3b-823dead1db64" released by "delete_volume" :: held 0.857s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:57 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6e961ec9-529d-42c8-a103-3542a5c49362 tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be.2f1d3c05-594a-4891-8a55-757adc087308" returned: 0 in 0.462s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-41e42d8c-8419-4adf-b238-90c12c749f72 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Created reservations ['57532a4d-9ed5-43cb-8d89-cff557e9d680', '88770d06-07e3-42a0-853a-ba8b3932a0a0', 'eab37635-3741-4d33-bb4a-4c4325255b40', 'fba0eafe-e5ca-4c4d-ab90-36425e7e2e5b'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6e961ec9-529d-42c8-a103-3542a5c49362 tempest-VolumeDependencyTests-768920191 None] Lock "cinder-quobyte-2f1d3c05-594a-4891-8a55-757adc087308" released by "_delete_snapshot" :: held 2.088s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:57 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6e961ec9-529d-42c8-a103-3542a5c49362 tempest-VolumeDependencyTests-768920191 None] Lock "cinder-quobyte-9ca941ba-9d06-4d20-a610-9b5be0bf60be" released by "delete_snapshot" :: held 2.112s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-41e42d8c-8419-4adf-b238-90c12c749f72 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-41e42d8c-8419-4adf-b238-90c12c749f72 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-41e42d8c-8419-4adf-b238-90c12c749f72 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-41e42d8c-8419-4adf-b238-90c12c749f72 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-41e42d8c-8419-4adf-b238-90c12c749f72 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-41e42d8c-8419-4adf-b238-90c12c749f72 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-6e961ec9-529d-42c8-a103-3542a5c49362 tempest-VolumeDependencyTests-768920191 None] Created reservations ['aa92e820-fc54-4bdb-99e1-e7addbf859a0', '97825360-e247-4665-945a-84d22e8177ed', '18af7bc0-6517-4b84-8780-3ac5393ceb08', '09dcebf4-b0b7-4498-a6cf-5924dd226a66'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:46:58 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:46:58 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:58 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-6e961ec9-529d-42c8-a103-3542a5c49362 tempest-VolumeDependencyTests-768920191 None] Delete snapshot completed successfully. Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-6e961ec9-529d-42c8-a103-3542a5c49362 tempest-VolumeDependencyTests-768920191 None] Lock "cinder-2f1d3c05-594a-4891-8a55-757adc087308-delete_snapshot" released by "delete_snapshot" :: held 2.232s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-16f60b14-0d11-4b37-8ef0-ff7ed709df7f tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "cinder-24a49ef3-32de-479e-9d13-1dbcc125388e-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-16f60b14-0d11-4b37-8ef0-ff7ed709df7f tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "cinder-24a49ef3-32de-479e-9d13-1dbcc125388e-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-16f60b14-0d11-4b37-8ef0-ff7ed709df7f tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "cinder-quobyte-24a49ef3-32de-479e-9d13-1dbcc125388e" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-16f60b14-0d11-4b37-8ef0-ff7ed709df7f tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "cinder-quobyte-24a49ef3-32de-479e-9d13-1dbcc125388e" acquired by "delete_volume" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[96aaabae-877e-41f2-a891-f266789c31c0]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-16f60b14-0d11-4b37-8ef0-ff7ed709df7f tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-24a49ef3-32de-479e-9d13-1dbcc125388e {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:58 devstack sudo[90797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-24a49ef3-32de-479e-9d13-1dbcc125388e Apr 02 12:46:58 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:58 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3abaf445-3c75-4512-a41b-415296c3a495 1073741824" returned: 0 in 0.579s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3abaf445-3c75-4512-a41b-415296c3a495 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:58 devstack sudo[90799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3abaf445-3c75-4512-a41b-415296c3a495 Apr 02 12:46:58 devstack sudo[90799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:58 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-41e42d8c-8419-4adf-b238-90c12c749f72 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.403s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-41e42d8c-8419-4adf-b238-90c12c749f72 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:46:58 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-41e42d8c-8419-4adf-b238-90c12c749f72 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Deleted volume successfully. Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-41e42d8c-8419-4adf-b238-90c12c749f72 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "cinder-4d49dbed-fa14-4ad3-9b3b-823dead1db64-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:58 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-16f60b14-0d11-4b37-8ef0-ff7ed709df7f tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-24a49ef3-32de-479e-9d13-1dbcc125388e" returned: 0 in 0.546s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-16f60b14-0d11-4b37-8ef0-ff7ed709df7f tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-24a49ef3-32de-479e-9d13-1dbcc125388e {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:58 devstack sudo[90806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-24a49ef3-32de-479e-9d13-1dbcc125388e Apr 02 12:46:58 devstack sudo[90799]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:58 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3abaf445-3c75-4512-a41b-415296c3a495" returned: 0 in 0.418s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.744s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1621788592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf0ebd6-299f-4f61-b497-c471b464ae23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='689c79fa2bf74c1ca0f276b8d8ca7e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:48Z,use_quota=True,user_id='a2c21337687840d3ad9bc5542b9b31ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Creating volume dbf0ebd6-299f-4f61-b497-c471b464ae23 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:46:58 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-dbf0ebd6-299f-4f61-b497-c471b464ae23 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76058120-47b3-4aaf-b9fb-8c7db90ed218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3abaf445-3c75-4512-a41b-415296c3a495', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:58 devstack sudo[90808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-dbf0ebd6-299f-4f61-b497-c471b464ae23 1073741824 Apr 02 12:46:58 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd962c3-d154-48da-b4e5-188dde6f5d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:58 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Volume volume-3abaf445-3c75-4512-a41b-415296c3a495 (3abaf445-3c75-4512-a41b-415296c3a495): created successfully Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd962c3-d154-48da-b4e5-188dde6f5d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Flow 'volume_create_manager' (3f349cd2-2331-4cb1-8fe8-b75d3fc300f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:58 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-6911a93d-fcf6-447a-9717-0b40efec081f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Created volume successfully. Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7bcf727-b19e-4241-975f-c897686354ea tempest-VolumeDependencyTests-768920191 None] Acquiring lock "cinder-9ca941ba-9d06-4d20-a610-9b5be0bf60be-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:58 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7bcf727-b19e-4241-975f-c897686354ea tempest-VolumeDependencyTests-768920191 None] Lock "cinder-9ca941ba-9d06-4d20-a610-9b5be0bf60be-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7bcf727-b19e-4241-975f-c897686354ea tempest-VolumeDependencyTests-768920191 None] Acquiring lock "cinder-quobyte-9ca941ba-9d06-4d20-a610-9b5be0bf60be" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7bcf727-b19e-4241-975f-c897686354ea tempest-VolumeDependencyTests-768920191 None] Lock "cinder-quobyte-9ca941ba-9d06-4d20-a610-9b5be0bf60be" acquired by "delete_volume" :: waited 0.017s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[349ffd3f-9631-4921-8e7d-19337303049d]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c7bcf727-b19e-4241-975f-c897686354ea tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:59 devstack sudo[90810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be Apr 02 12:46:59 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:59 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-16f60b14-0d11-4b37-8ef0-ff7ed709df7f tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-24a49ef3-32de-479e-9d13-1dbcc125388e" returned: 0 in 0.415s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-16f60b14-0d11-4b37-8ef0-ff7ed709df7f tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "cinder-quobyte-24a49ef3-32de-479e-9d13-1dbcc125388e" released by "delete_volume" :: held 0.982s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-16f60b14-0d11-4b37-8ef0-ff7ed709df7f tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Created reservations ['d4d27e28-cb2f-4bb9-b532-2eb236a6c293', '2fee8efe-af07-4bb0-ab63-c8c0f3f1b35c', '105d2f08-09c4-4662-bffa-3a44c0ba3293', '9997326b-d06d-476a-b77c-82ad176cf158'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-16f60b14-0d11-4b37-8ef0-ff7ed709df7f tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-16f60b14-0d11-4b37-8ef0-ff7ed709df7f tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-16f60b14-0d11-4b37-8ef0-ff7ed709df7f tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-16f60b14-0d11-4b37-8ef0-ff7ed709df7f tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-16f60b14-0d11-4b37-8ef0-ff7ed709df7f tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-16f60b14-0d11-4b37-8ef0-ff7ed709df7f tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:59 devstack sudo[90816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:46:59 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:59 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-dbf0ebd6-299f-4f61-b497-c471b464ae23 1073741824" returned: 0 in 0.539s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-dbf0ebd6-299f-4f61-b497-c471b464ae23 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:59 devstack sudo[90818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-dbf0ebd6-299f-4f61-b497-c471b464ae23 Apr 02 12:46:59 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:59 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c7bcf727-b19e-4241-975f-c897686354ea tempest-VolumeDependencyTests-768920191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be" returned: 0 in 0.500s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c7bcf727-b19e-4241-975f-c897686354ea tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:59 devstack sudo[90823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be Apr 02 12:46:59 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:59 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-16f60b14-0d11-4b37-8ef0-ff7ed709df7f tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.415s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-16f60b14-0d11-4b37-8ef0-ff7ed709df7f tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:46:59 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-16f60b14-0d11-4b37-8ef0-ff7ed709df7f tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Deleted volume successfully. Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-16f60b14-0d11-4b37-8ef0-ff7ed709df7f tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "cinder-24a49ef3-32de-479e-9d13-1dbcc125388e-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:59 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-dbf0ebd6-299f-4f61-b497-c471b464ae23" returned: 0 in 0.415s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.584s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67767d6b-d9ab-4a59-b27a-617c699b7147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300719e6d60e4e418c7edc921fc1acdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:46:48Z,use_quota=True,user_id='02f73e7e43e7445798114fab218164ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Creating volume 67767d6b-d9ab-4a59-b27a-617c699b7147 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:46:59 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-67767d6b-d9ab-4a59-b27a-617c699b7147 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:46:59 devstack sudo[90827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-67767d6b-d9ab-4a59-b27a-617c699b7147 1073741824 Apr 02 12:46:59 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23b2c414-1e3c-44f0-a3f8-c65d47e16a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbf0ebd6-299f-4f61-b497-c471b464ae23', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10471f6e-defc-4623-9429-349c8c731d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:46:59 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Volume volume-dbf0ebd6-299f-4f61-b497-c471b464ae23 (dbf0ebd6-299f-4f61-b497-c471b464ae23): created successfully Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10471f6e-defc-4623-9429-349c8c731d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Flow 'volume_create_manager' (490e7656-969f-44b8-a48a-58e751b6f600) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:46:59 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-83a23ae6-f708-4df1-b468-36bd32049ba3 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Created volume successfully. Apr 02 12:46:59 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c7bcf727-b19e-4241-975f-c897686354ea tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9ca941ba-9d06-4d20-a610-9b5be0bf60be" returned: 0 in 0.426s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7bcf727-b19e-4241-975f-c897686354ea tempest-VolumeDependencyTests-768920191 None] Lock "cinder-quobyte-9ca941ba-9d06-4d20-a610-9b5be0bf60be" released by "delete_volume" :: held 0.954s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:46:59 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-c7bcf727-b19e-4241-975f-c897686354ea tempest-VolumeDependencyTests-768920191 None] Created reservations ['2464d78d-669f-4dfc-953b-950f47669007', '56d57662-46c8-47c2-9e1c-49c55cebedd0', '688c0519-4b5d-4933-b280-6e3ee54af731', 'a071c0c9-447e-42b8-9515-c55db313d1bf'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c7bcf727-b19e-4241-975f-c897686354ea tempest-VolumeDependencyTests-768920191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c7bcf727-b19e-4241-975f-c897686354ea tempest-VolumeDependencyTests-768920191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c7bcf727-b19e-4241-975f-c897686354ea tempest-VolumeDependencyTests-768920191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c7bcf727-b19e-4241-975f-c897686354ea tempest-VolumeDependencyTests-768920191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c7bcf727-b19e-4241-975f-c897686354ea tempest-VolumeDependencyTests-768920191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c7bcf727-b19e-4241-975f-c897686354ea tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:00 devstack sudo[90830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:47:00 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:00 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-67767d6b-d9ab-4a59-b27a-617c699b7147 1073741824" returned: 0 in 0.503s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-67767d6b-d9ab-4a59-b27a-617c699b7147 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-941664db-a849-4d25-ac7d-5522e322adb9 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "cinder-e8f314b1-0fab-4fd3-804d-fdc639608378-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:00 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-67767d6b-d9ab-4a59-b27a-617c699b7147 Apr 02 12:47:00 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-941664db-a849-4d25-ac7d-5522e322adb9 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "cinder-e8f314b1-0fab-4fd3-804d-fdc639608378-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Flow 'volume_create_manager' (7c673928-1c55-4211-ba6e-0f5751a62689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65185f5f-e72f-4f24-b89f-57abbe713544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-941664db-a849-4d25-ac7d-5522e322adb9 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "cinder-quobyte-e8f314b1-0fab-4fd3-804d-fdc639608378" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65185f5f-e72f-4f24-b89f-57abbe713544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2107385715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9032e5f4-cf5c-403c-9d5b-6855892d8e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae693f85263e497786be4c9f2184096b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:47:00Z,use_quota=True,user_id='6efbd1566bd84e31b87325368b605a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffce521a-9992-4a59-9103-9f49ed7922b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffce521a-9992-4a59-9103-9f49ed7922b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f6aa2a-1ece-42a7-ae1f-3e8ec7db0339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f6aa2a-1ece-42a7-ae1f-3e8ec7db0339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9032e5f4-cf5c-403c-9d5b-6855892d8e17', 'volume_name': 'volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c124207-6c0d-4d2a-8984-01406ee3246c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c124207-6c0d-4d2a-8984-01406ee3246c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5fd4e6-b8ba-41cc-bb1d-1aa2328cda8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:00 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Volume 9032e5f4-cf5c-403c-9d5b-6855892d8e17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17', 'volume_size': 1} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-941664db-a849-4d25-ac7d-5522e322adb9 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "cinder-quobyte-e8f314b1-0fab-4fd3-804d-fdc639608378" acquired by "delete_volume" :: waited 0.042s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03c9e46-1abb-45d5-a836-68251d1cf64e]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-941664db-a849-4d25-ac7d-5522e322adb9 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e8f314b1-0fab-4fd3-804d-fdc639608378 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:00 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c7bcf727-b19e-4241-975f-c897686354ea tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.444s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-c7bcf727-b19e-4241-975f-c897686354ea tempest-VolumeDependencyTests-768920191 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:47:00 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-c7bcf727-b19e-4241-975f-c897686354ea tempest-VolumeDependencyTests-768920191 None] Deleted volume successfully. Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c7bcf727-b19e-4241-975f-c897686354ea tempest-VolumeDependencyTests-768920191 None] Lock "cinder-9ca941ba-9d06-4d20-a610-9b5be0bf60be-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:00 devstack sudo[90838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e8f314b1-0fab-4fd3-804d-fdc639608378 Apr 02 12:47:00 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:00 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-67767d6b-d9ab-4a59-b27a-617c699b7147" returned: 0 in 0.435s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.295s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2107385715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9032e5f4-cf5c-403c-9d5b-6855892d8e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae693f85263e497786be4c9f2184096b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:47:00Z,use_quota=True,user_id='6efbd1566bd84e31b87325368b605a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Creating volume 9032e5f4-cf5c-403c-9d5b-6855892d8e17 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:47:00 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3556f4c3-798c-4c8a-ab3f-a00dec633c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67767d6b-d9ab-4a59-b27a-617c699b7147', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (393efff1-8b7c-4b88-93ea-b53855172d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:00 devstack sudo[90841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17 1073741824 Apr 02 12:47:00 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:00 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Volume volume-67767d6b-d9ab-4a59-b27a-617c699b7147 (67767d6b-d9ab-4a59-b27a-617c699b7147): created successfully Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (393efff1-8b7c-4b88-93ea-b53855172d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Flow 'volume_create_manager' (18c36561-902d-4bdc-a306-8c4c502e6c55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:47:00 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-ae848aca-6267-4989-bf07-f428f7ea65bb tempest-CinderUnicodeTest-967695934 None] Created volume successfully. Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c2093bd0-f23c-4147-9bfc-2a3cf5396998 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "cinder-dbf0ebd6-299f-4f61-b497-c471b464ae23-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c2093bd0-f23c-4147-9bfc-2a3cf5396998 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-dbf0ebd6-299f-4f61-b497-c471b464ae23-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c2093bd0-f23c-4147-9bfc-2a3cf5396998 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "cinder-quobyte-dbf0ebd6-299f-4f61-b497-c471b464ae23" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c2093bd0-f23c-4147-9bfc-2a3cf5396998 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-quobyte-dbf0ebd6-299f-4f61-b497-c471b464ae23" acquired by "delete_volume" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5e4dc8-d92d-4f72-bcb9-1b0f6af0cc30]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c2093bd0-f23c-4147-9bfc-2a3cf5396998 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-dbf0ebd6-299f-4f61-b497-c471b464ae23 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:00 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-941664db-a849-4d25-ac7d-5522e322adb9 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e8f314b1-0fab-4fd3-804d-fdc639608378" returned: 0 in 0.518s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:00 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-941664db-a849-4d25-ac7d-5522e322adb9 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e8f314b1-0fab-4fd3-804d-fdc639608378 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:01 devstack sudo[90847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e8f314b1-0fab-4fd3-804d-fdc639608378 Apr 02 12:47:01 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:01 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-dbf0ebd6-299f-4f61-b497-c471b464ae23 Apr 02 12:47:01 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Flow 'volume_create_manager' (b4d167cf-4bd4-4521-b7ed-4cfa929374bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0bb6db-4169-452c-a005-b1bfb8ae82b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0bb6db-4169-452c-a005-b1bfb8ae82b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:47:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1268814394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acb78b0a-852a-4038-bc9b-eee25223d876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300719e6d60e4e418c7edc921fc1acdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:47:01Z,use_quota=True,user_id='02f73e7e43e7445798114fab218164ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a3408e-6e6b-4387-9f67-e6aa1a8311b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a3408e-6e6b-4387-9f67-e6aa1a8311b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70bfd3b4-ddbc-4b9d-98f9-92f709a4e790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70bfd3b4-ddbc-4b9d-98f9-92f709a4e790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acb78b0a-852a-4038-bc9b-eee25223d876', 'volume_name': 'volume-acb78b0a-852a-4038-bc9b-eee25223d876', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9996e6af-467a-4b6c-9dab-de8d8665907a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9996e6af-467a-4b6c-9dab-de8d8665907a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (384db99f-5aff-4530-8d5d-2646aa44fb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:01 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Volume acb78b0a-852a-4038-bc9b-eee25223d876: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acb78b0a-852a-4038-bc9b-eee25223d876', 'volume_size': 1} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:01 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17 1073741824" returned: 0 in 0.571s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:01 devstack sudo[90853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17 Apr 02 12:47:01 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:01 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-941664db-a849-4d25-ac7d-5522e322adb9 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-e8f314b1-0fab-4fd3-804d-fdc639608378" returned: 0 in 0.514s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-941664db-a849-4d25-ac7d-5522e322adb9 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "cinder-quobyte-e8f314b1-0fab-4fd3-804d-fdc639608378" released by "delete_volume" :: held 1.055s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:01 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c2093bd0-f23c-4147-9bfc-2a3cf5396998 tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-dbf0ebd6-299f-4f61-b497-c471b464ae23" returned: 0 in 0.560s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c2093bd0-f23c-4147-9bfc-2a3cf5396998 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-dbf0ebd6-299f-4f61-b497-c471b464ae23 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-941664db-a849-4d25-ac7d-5522e322adb9 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Created reservations ['fc18c6a5-5ead-4ef3-ac1f-ddf8d5cfbeae', '88b52bf8-5571-4018-bb5f-813c4b50bac8', '2652f85f-e2a3-49dc-8325-82d6cef51e70', '2eecb3ba-95c1-41fe-9390-f35594d19c49'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:47:01 devstack sudo[90859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-dbf0ebd6-299f-4f61-b497-c471b464ae23 Apr 02 12:47:01 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-941664db-a849-4d25-ac7d-5522e322adb9 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-941664db-a849-4d25-ac7d-5522e322adb9 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-941664db-a849-4d25-ac7d-5522e322adb9 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-941664db-a849-4d25-ac7d-5522e322adb9 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-941664db-a849-4d25-ac7d-5522e322adb9 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-941664db-a849-4d25-ac7d-5522e322adb9 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:01 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:47:01 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:01 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17" returned: 0 in 0.410s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.475s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:47:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1268814394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acb78b0a-852a-4038-bc9b-eee25223d876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300719e6d60e4e418c7edc921fc1acdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:47:01Z,use_quota=True,user_id='02f73e7e43e7445798114fab218164ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Creating volume acb78b0a-852a-4038-bc9b-eee25223d876 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:47:01 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5fd4e6-b8ba-41cc-bb1d-1aa2328cda8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:01 devstack sudo[90864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876 1073741824 Apr 02 12:47:01 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998e67d1-33c8-40f7-8f63-3fd1120a712c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:01 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Volume volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17 (9032e5f4-cf5c-403c-9d5b-6855892d8e17): created successfully Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998e67d1-33c8-40f7-8f63-3fd1120a712c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Flow 'volume_create_manager' (7c673928-1c55-4211-ba6e-0f5751a62689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:47:01 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-628bc1a3-2f3d-4f20-839b-21f5d14ae84a tempest-VolumeDependencyTests-768920191 None] Created volume successfully. Apr 02 12:47:01 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c2093bd0-f23c-4147-9bfc-2a3cf5396998 tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-dbf0ebd6-299f-4f61-b497-c471b464ae23" returned: 0 in 0.418s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c2093bd0-f23c-4147-9bfc-2a3cf5396998 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-quobyte-dbf0ebd6-299f-4f61-b497-c471b464ae23" released by "delete_volume" :: held 1.008s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:01 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-c2093bd0-f23c-4147-9bfc-2a3cf5396998 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Created reservations ['13a9d31a-2aa4-41b9-b5a8-f8fef5fe1424', '7ba7d4b9-bcc7-4932-a917-279b85c5f1bb', '4a2fabff-afaf-4cb0-af0a-c31b176259f7', 'f906c7a6-e2ed-4527-89da-a4c9aae77b28'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c2093bd0-f23c-4147-9bfc-2a3cf5396998 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c2093bd0-f23c-4147-9bfc-2a3cf5396998 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c2093bd0-f23c-4147-9bfc-2a3cf5396998 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-c2093bd0-f23c-4147-9bfc-2a3cf5396998 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-c2093bd0-f23c-4147-9bfc-2a3cf5396998 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c2093bd0-f23c-4147-9bfc-2a3cf5396998 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:02 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-941664db-a849-4d25-ac7d-5522e322adb9 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.450s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-941664db-a849-4d25-ac7d-5522e322adb9 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:47:02 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-941664db-a849-4d25-ac7d-5522e322adb9 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Deleted volume successfully. Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-941664db-a849-4d25-ac7d-5522e322adb9 tempest-CreateVolumesFromSourceVolumeTest-1490712537 None] Lock "cinder-e8f314b1-0fab-4fd3-804d-fdc639608378-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:02 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:47:02 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:02 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876 1073741824" returned: 0 in 0.488s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:02 devstack sudo[90873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876 Apr 02 12:47:02 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:02 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-c2093bd0-f23c-4147-9bfc-2a3cf5396998 tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.526s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-c2093bd0-f23c-4147-9bfc-2a3cf5396998 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:47:02 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-c2093bd0-f23c-4147-9bfc-2a3cf5396998 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Deleted volume successfully. Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-c2093bd0-f23c-4147-9bfc-2a3cf5396998 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-dbf0ebd6-299f-4f61-b497-c471b464ae23-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Flow 'volume_create_manager' (9106c7a3-39c3-456f-a214-e55d619d6d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b57c5e82-fd83-4271-acc4-4d624385127d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b57c5e82-fd83-4271-acc4-4d624385127d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-9676879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45616de2-2a7f-4160-ac73-165668cb0341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae693f85263e497786be4c9f2184096b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9032e5f4-cf5c-403c-9d5b-6855892d8e17,status='creating',terminated_at=None,updated_at=2026-04-02T10:47:03Z,use_quota=True,user_id='6efbd1566bd84e31b87325368b605a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2361e5-5e05-46ed-9a3d-e0c42d09ec29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2361e5-5e05-46ed-9a3d-e0c42d09ec29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abbb1a5d-9b75-4088-b913-01626b8a76cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abbb1a5d-9b75-4088-b913-01626b8a76cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '45616de2-2a7f-4160-ac73-165668cb0341', 'volume_name': 'volume-45616de2-2a7f-4160-ac73-165668cb0341', 'volume_size': 1, 'source_volid': '9032e5f4-cf5c-403c-9d5b-6855892d8e17', 'source_volstatus': 'available'}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f39497-085a-4c46-bae9-c5dfc41873c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f39497-085a-4c46-bae9-c5dfc41873c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:02 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce56b715-6479-4580-8669-f64edc22d4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:02 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Volume 45616de2-2a7f-4160-ac73-165668cb0341: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-45616de2-2a7f-4160-ac73-165668cb0341', 'volume_size': 1, 'source_volid': '9032e5f4-cf5c-403c-9d5b-6855892d8e17', 'source_volstatus': 'available'} Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876" returned: 0 in 0.537s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:02 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Cloning volume 9032e5f4-cf5c-403c-9d5b-6855892d8e17 to volume 45616de2-2a7f-4160-ac73-165668cb0341 Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (384db99f-5aff-4530-8d5d-2646aa44fb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acb78b0a-852a-4038-bc9b-eee25223d876', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49fe0385-31b3-4495-b4fb-bb831bbf374b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:02 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Volume volume-acb78b0a-852a-4038-bc9b-eee25223d876 (acb78b0a-852a-4038-bc9b-eee25223d876): created successfully Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49fe0385-31b3-4495-b4fb-bb831bbf374b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Flow 'volume_create_manager' (b4d167cf-4bd4-4521-b7ed-4cfa929374bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Creating offline snapshot 5ea1f492-104a-4e7e-9070-da80894595a7 of volume 9032e5f4-cf5c-403c-9d5b-6855892d8e17 {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:47:02 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-63867608-c4b0-4a24-9c4b-2b173980e016 tempest-CinderUnicodeTest-967695934 None] Created volume successfully. Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fd0624-1b8b-45f8-a802-97ecc69ba909]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:02 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:02 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17 Apr 02 12:47:02 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:03 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2246894e-7dcc-42de-9406-7a265e4c4df6 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "cinder-3abaf445-3c75-4512-a41b-415296c3a495-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:03 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2246894e-7dcc-42de-9406-7a265e4c4df6 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-3abaf445-3c75-4512-a41b-415296c3a495-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:03 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2246894e-7dcc-42de-9406-7a265e4c4df6 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "cinder-quobyte-3abaf445-3c75-4512-a41b-415296c3a495" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:03 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2246894e-7dcc-42de-9406-7a265e4c4df6 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-quobyte-3abaf445-3c75-4512-a41b-415296c3a495" acquired by "delete_volume" :: waited 0.007s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:03 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[3325b814-47f6-4bbd-bd67-713198116d43]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2246894e-7dcc-42de-9406-7a265e4c4df6 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3abaf445-3c75-4512-a41b-415296c3a495 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:03 devstack sudo[90879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3abaf445-3c75-4512-a41b-415296c3a495 Apr 02 12:47:03 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:03 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17" returned: 0 in 0.526s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.5ea1f492-104a-4e7e-9070-da80894595a7 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:03 devstack sudo[90884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.5ea1f492-104a-4e7e-9070-da80894595a7 1G Apr 02 12:47:03 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a1a0de3c-c774-4983-9b92-6d69154605fc tempest-CinderUnicodeTest-967695934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:03 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2246894e-7dcc-42de-9406-7a265e4c4df6 tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3abaf445-3c75-4512-a41b-415296c3a495" returned: 0 in 0.612s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2246894e-7dcc-42de-9406-7a265e4c4df6 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3abaf445-3c75-4512-a41b-415296c3a495 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:03 devstack sudo[90889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3abaf445-3c75-4512-a41b-415296c3a495 Apr 02 12:47:03 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:03 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.5ea1f492-104a-4e7e-9070-da80894595a7 1G" returned: 0 in 0.583s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:03 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.5ea1f492-104a-4e7e-9070-da80894595a7 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:04 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.5ea1f492-104a-4e7e-9070-da80894595a7 Apr 02 12:47:04 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:04 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2246894e-7dcc-42de-9406-7a265e4c4df6 tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-3abaf445-3c75-4512-a41b-415296c3a495" returned: 0 in 0.493s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:04 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2246894e-7dcc-42de-9406-7a265e4c4df6 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-quobyte-3abaf445-3c75-4512-a41b-415296c3a495" released by "delete_volume" :: held 1.135s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:04 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-2246894e-7dcc-42de-9406-7a265e4c4df6 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Created reservations ['849a1890-9c23-45cc-839e-67d733ba0d23', 'b23c9c85-04c2-4428-8e7f-1155d0a5f96e', 'dc4bb3a0-69fe-40b1-b14c-3e910f0032d4', 'daf96387-7f25-402d-9ccc-2c621ac7515e'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:47:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2246894e-7dcc-42de-9406-7a265e4c4df6 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2246894e-7dcc-42de-9406-7a265e4c4df6 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:04 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2246894e-7dcc-42de-9406-7a265e4c4df6 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:47:04 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-2246894e-7dcc-42de-9406-7a265e4c4df6 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:47:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-2246894e-7dcc-42de-9406-7a265e4c4df6 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2246894e-7dcc-42de-9406-7a265e4c4df6 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:04 devstack sudo[90897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:47:04 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:04 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.5ea1f492-104a-4e7e-9070-da80894595a7" returned: 0 in 0.490s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:04 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.5ea1f492-104a-4e7e-9070-da80894595a7 is being set with open permissions: ugo+rw Apr 02 12:47:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.5ea1f492-104a-4e7e-9070-da80894595a7 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:04 devstack sudo[90902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.5ea1f492-104a-4e7e-9070-da80894595a7 Apr 02 12:47:04 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:04 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2246894e-7dcc-42de-9406-7a265e4c4df6 tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.466s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:04 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-2246894e-7dcc-42de-9406-7a265e4c4df6 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:47:04 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-2246894e-7dcc-42de-9406-7a265e4c4df6 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Deleted volume successfully. Apr 02 12:47:04 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2246894e-7dcc-42de-9406-7a265e4c4df6 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-3abaf445-3c75-4512-a41b-415296c3a495-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:04 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.5ea1f492-104a-4e7e-9070-da80894595a7" returned: 0 in 0.452s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:04 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:04 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.info Apr 02 12:47:04 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:05 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0592ac80-2ed4-4dcc-88f7-b8522a5ddc34 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "cinder-0bef1b4b-5145-47db-aafa-fbe6d45755cb-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:05 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0592ac80-2ed4-4dcc-88f7-b8522a5ddc34 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-0bef1b4b-5145-47db-aafa-fbe6d45755cb-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:05 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0592ac80-2ed4-4dcc-88f7-b8522a5ddc34 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "cinder-quobyte-0bef1b4b-5145-47db-aafa-fbe6d45755cb" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:05 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0592ac80-2ed4-4dcc-88f7-b8522a5ddc34 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-quobyte-0bef1b4b-5145-47db-aafa-fbe6d45755cb" acquired by "delete_volume" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:05 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e3bd1e-20fd-432c-a067-a3ad1fd7f22b]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0592ac80-2ed4-4dcc-88f7-b8522a5ddc34 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0bef1b4b-5145-47db-aafa-fbe6d45755cb {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:05 devstack sudo[90909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0bef1b4b-5145-47db-aafa-fbe6d45755cb Apr 02 12:47:05 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:05 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.info" returned: 0 in 0.438s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:05 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.info is being set with open permissions: ugo+rw Apr 02 12:47:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:05 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.info Apr 02 12:47:05 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:05 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.info" returned: 0 in 0.432s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:05 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:05 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Acquiring lock "cinder-quobyte-45616de2-2a7f-4160-ac73-165668cb0341" by "_copy_volume_from_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0592ac80-2ed4-4dcc-88f7-b8522a5ddc34 tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0bef1b4b-5145-47db-aafa-fbe6d45755cb" returned: 0 in 0.547s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0592ac80-2ed4-4dcc-88f7-b8522a5ddc34 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0bef1b4b-5145-47db-aafa-fbe6d45755cb {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:05 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Lock "cinder-quobyte-45616de2-2a7f-4160-ac73-165668cb0341" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:05 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] snapshot: 5ea1f492-104a-4e7e-9070-da80894595a7, volume: 45616de2-2a7f-4160-ac73-165668cb0341, {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 12:47:05 devstack sudo[90917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0bef1b4b-5145-47db-aafa-fbe6d45755cb Apr 02 12:47:05 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:05 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:47:05 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:47:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:05 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c72c2e1-0a99-4ded-a8e1-66e2e7dd3c81]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:05 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.5ea1f492-104a-4e7e-9070-da80894595a7 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:05 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.5ea1f492-104a-4e7e-9070-da80894595a7 Apr 02 12:47:05 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:06 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0592ac80-2ed4-4dcc-88f7-b8522a5ddc34 tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-0bef1b4b-5145-47db-aafa-fbe6d45755cb" returned: 0 in 0.410s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:06 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0592ac80-2ed4-4dcc-88f7-b8522a5ddc34 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-quobyte-0bef1b4b-5145-47db-aafa-fbe6d45755cb" released by "delete_volume" :: held 0.990s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:06 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-0592ac80-2ed4-4dcc-88f7-b8522a5ddc34 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Created reservations ['aaa3471b-d65f-4407-b861-7f15dc2da030', '7b9dff0d-fe25-45de-9bf5-56084359410e', '565e8eb7-b9ef-4449-9632-a370ebfbc56e', 'd187b31c-2933-472c-b97f-1717df9baf4d'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:47:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0592ac80-2ed4-4dcc-88f7-b8522a5ddc34 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0592ac80-2ed4-4dcc-88f7-b8522a5ddc34 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:06 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-0592ac80-2ed4-4dcc-88f7-b8522a5ddc34 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:47:06 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-0592ac80-2ed4-4dcc-88f7-b8522a5ddc34 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:47:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-0592ac80-2ed4-4dcc-88f7-b8522a5ddc34 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0592ac80-2ed4-4dcc-88f7-b8522a5ddc34 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:06 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.5ea1f492-104a-4e7e-9070-da80894595a7" returned: 0 in 0.495s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:06 devstack sudo[90925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:47:06 devstack sudo[90925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:06 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:47:06 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17 {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 12:47:06 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Creating direct copy from snapshot {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 12:47:06 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b7f15a-3dc8-482e-baf7-c141087f0581]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:06 devstack sudo[90927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17 Apr 02 12:47:06 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:06 devstack sudo[90925]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-0592ac80-2ed4-4dcc-88f7-b8522a5ddc34 tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.433s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:06 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-0592ac80-2ed4-4dcc-88f7-b8522a5ddc34 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:47:06 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-0592ac80-2ed4-4dcc-88f7-b8522a5ddc34 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Deleted volume successfully. Apr 02 12:47:06 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-0592ac80-2ed4-4dcc-88f7-b8522a5ddc34 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-0bef1b4b-5145-47db-aafa-fbe6d45755cb-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:06 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17" returned: 0 in 0.508s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:06 devstack cinder-volume[82819]: DEBUG cinder.utils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Path /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-45616de2-2a7f-4160-ac73-165668cb0341 not found in is_blk_device check {{(pid=82819) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 12:47:06 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-45616de2-2a7f-4160-ac73-165668cb0341 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:06 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-45616de2-2a7f-4160-ac73-165668cb0341 Apr 02 12:47:06 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:07 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-627da12a-c296-4a11-bdd3-efcfa1c6fd46 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "cinder-a662bb38-789f-47b1-a5f3-b82baf41bf8a-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:07 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-627da12a-c296-4a11-bdd3-efcfa1c6fd46 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-a662bb38-789f-47b1-a5f3-b82baf41bf8a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:07 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-627da12a-c296-4a11-bdd3-efcfa1c6fd46 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "cinder-quobyte-a662bb38-789f-47b1-a5f3-b82baf41bf8a" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:07 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-627da12a-c296-4a11-bdd3-efcfa1c6fd46 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-quobyte-a662bb38-789f-47b1-a5f3-b82baf41bf8a" acquired by "delete_volume" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:07 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2e604e-6c9e-45e4-aed1-5c76711be923]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:07 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-627da12a-c296-4a11-bdd3-efcfa1c6fd46 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a662bb38-789f-47b1-a5f3-b82baf41bf8a {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:08 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a662bb38-789f-47b1-a5f3-b82baf41bf8a Apr 02 12:47:08 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:09 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-45616de2-2a7f-4160-ac73-165668cb0341" returned: 0 in 2.235s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:09 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[733e8bc0-ffca-4187-a21c-89e75427561e]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:09 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-627da12a-c296-4a11-bdd3-efcfa1c6fd46 tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a662bb38-789f-47b1-a5f3-b82baf41bf8a" returned: 0 in 1.611s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-627da12a-c296-4a11-bdd3-efcfa1c6fd46 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a662bb38-789f-47b1-a5f3-b82baf41bf8a {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:09 devstack sudo[90959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a662bb38-789f-47b1-a5f3-b82baf41bf8a Apr 02 12:47:09 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:09 devstack sudo[90958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17 Apr 02 12:47:09 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:09 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-627da12a-c296-4a11-bdd3-efcfa1c6fd46 tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a662bb38-789f-47b1-a5f3-b82baf41bf8a" returned: 0 in 0.436s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:09 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-627da12a-c296-4a11-bdd3-efcfa1c6fd46 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-quobyte-a662bb38-789f-47b1-a5f3-b82baf41bf8a" released by "delete_volume" :: held 2.088s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:09 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-627da12a-c296-4a11-bdd3-efcfa1c6fd46 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Created reservations ['90f2a104-962e-4605-9e65-7bb0600176fc', '342c330f-327d-4e3e-b9f9-3ec4d85b4931', '94b5877a-ef32-46d0-b78c-de04c4805382', 'ac72ab6c-e193-48e8-b81a-9f1e497ee452'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:47:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-627da12a-c296-4a11-bdd3-efcfa1c6fd46 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-627da12a-c296-4a11-bdd3-efcfa1c6fd46 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:09 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-627da12a-c296-4a11-bdd3-efcfa1c6fd46 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:47:09 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-627da12a-c296-4a11-bdd3-efcfa1c6fd46 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:47:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-627da12a-c296-4a11-bdd3-efcfa1c6fd46 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-627da12a-c296-4a11-bdd3-efcfa1c6fd46 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:09 devstack sudo[90966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:47:09 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:09 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17" returned: 0 in 0.609s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:09 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17, size 1024.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-45616de2-2a7f-4160-ac73-165668cb0341 {{(pid=82819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 12:47:09 devstack cinder-volume[82819]: INFO cinder.image.image_utils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Converted 1024.00 MB image at 457.94 MB/s Apr 02 12:47:09 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-45616de2-2a7f-4160-ac73-165668cb0341 is being set with open permissions: ugo+rw Apr 02 12:47:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-45616de2-2a7f-4160-ac73-165668cb0341 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:09 devstack sudo[90968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-45616de2-2a7f-4160-ac73-165668cb0341 Apr 02 12:47:09 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:09 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-5ee50793-7206-44bd-845b-2a54e66cff4f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "cinder-1981ae70-d84e-49dc-8ee5-964360194915-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:09 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-5ee50793-7206-44bd-845b-2a54e66cff4f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-1981ae70-d84e-49dc-8ee5-964360194915-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:09 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-5ee50793-7206-44bd-845b-2a54e66cff4f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "cinder-quobyte-1981ae70-d84e-49dc-8ee5-964360194915" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:09 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-5ee50793-7206-44bd-845b-2a54e66cff4f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-quobyte-1981ae70-d84e-49dc-8ee5-964360194915" acquired by "delete_volume" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:09 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1a3661-ce6b-4f89-838d-56bd633c1d09]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:09 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5ee50793-7206-44bd-845b-2a54e66cff4f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1981ae70-d84e-49dc-8ee5-964360194915 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:10 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1981ae70-d84e-49dc-8ee5-964360194915 Apr 02 12:47:10 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:10 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-627da12a-c296-4a11-bdd3-efcfa1c6fd46 tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.400s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:10 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-627da12a-c296-4a11-bdd3-efcfa1c6fd46 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:47:10 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-627da12a-c296-4a11-bdd3-efcfa1c6fd46 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Deleted volume successfully. Apr 02 12:47:10 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-627da12a-c296-4a11-bdd3-efcfa1c6fd46 tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-a662bb38-789f-47b1-a5f3-b82baf41bf8a-delete_volume" released by "delete_volume" :: held 2.628s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:10 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-45616de2-2a7f-4160-ac73-165668cb0341" returned: 0 in 0.497s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:10 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Lock "cinder-quobyte-45616de2-2a7f-4160-ac73-165668cb0341" released by "_copy_volume_from_snapshot" :: held 4.402s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:10 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Acquiring lock "cinder-quobyte-5ea1f492-104a-4e7e-9070-da80894595a7" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:10 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Lock "cinder-quobyte-5ea1f492-104a-4e7e-9070-da80894595a7" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:10 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Deleting offline snapshot 5ea1f492-104a-4e7e-9070-da80894595a7 of volume 9032e5f4-cf5c-403c-9d5b-6855892d8e17 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:47:10 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] snapshot_file for this snap is: volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.5ea1f492-104a-4e7e-9070-da80894595a7 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:47:10 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bf2863-6ac6-4af3-92ab-eecb39f7ebb6]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.5ea1f492-104a-4e7e-9070-da80894595a7 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:10 devstack sudo[90974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.5ea1f492-104a-4e7e-9070-da80894595a7 Apr 02 12:47:10 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:10 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5ee50793-7206-44bd-845b-2a54e66cff4f tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1981ae70-d84e-49dc-8ee5-964360194915" returned: 0 in 0.528s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5ee50793-7206-44bd-845b-2a54e66cff4f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1981ae70-d84e-49dc-8ee5-964360194915 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:10 devstack sudo[90979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1981ae70-d84e-49dc-8ee5-964360194915 Apr 02 12:47:10 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:10 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.5ea1f492-104a-4e7e-9070-da80894595a7" returned: 0 in 0.481s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:10 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:47:10 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[092db1f6-e6ff-45d8-b56b-9d4be10a6fd7]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:10 devstack sudo[90984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17 Apr 02 12:47:10 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:10 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5ee50793-7206-44bd-845b-2a54e66cff4f tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-1981ae70-d84e-49dc-8ee5-964360194915" returned: 0 in 0.446s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:10 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-5ee50793-7206-44bd-845b-2a54e66cff4f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-quobyte-1981ae70-d84e-49dc-8ee5-964360194915" released by "delete_volume" :: held 0.994s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:10 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-5ee50793-7206-44bd-845b-2a54e66cff4f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Created reservations ['f4f4f194-8e07-4456-b0be-b10930c3270c', 'a1872ebc-43f9-4e43-bfef-4138522cac55', 'f119dc58-3bfc-418b-b008-0a629bd4db8b', '223a78f6-7486-47f4-91a8-e790cdb65878'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:47:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-5ee50793-7206-44bd-845b-2a54e66cff4f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:10 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-5ee50793-7206-44bd-845b-2a54e66cff4f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:10 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-5ee50793-7206-44bd-845b-2a54e66cff4f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:47:11 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-5ee50793-7206-44bd-845b-2a54e66cff4f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:47:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-5ee50793-7206-44bd-845b-2a54e66cff4f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5ee50793-7206-44bd-845b-2a54e66cff4f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:11 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2bb7d25c-b6eb-45d9-b1b3-fc2ca75d524b tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "cinder-a3db0ed9-f223-4816-be8c-a66508ca6a4a-delete_snapshot" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:11 devstack sudo[90987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:47:11 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:11 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2bb7d25c-b6eb-45d9-b1b3-fc2ca75d524b tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-a3db0ed9-f223-4816-be8c-a66508ca6a4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:11 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2bb7d25c-b6eb-45d9-b1b3-fc2ca75d524b tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "cinder-quobyte-21e345c0-aa34-41f4-a16c-82cae2283e8f" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:11 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2bb7d25c-b6eb-45d9-b1b3-fc2ca75d524b tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-quobyte-21e345c0-aa34-41f4-a16c-82cae2283e8f" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:11 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2bb7d25c-b6eb-45d9-b1b3-fc2ca75d524b tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "cinder-quobyte-a3db0ed9-f223-4816-be8c-a66508ca6a4a" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:11 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2bb7d25c-b6eb-45d9-b1b3-fc2ca75d524b tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-quobyte-a3db0ed9-f223-4816-be8c-a66508ca6a4a" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:11 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-2bb7d25c-b6eb-45d9-b1b3-fc2ca75d524b tempest-CreateVolumesFromSnapshotTest-1385949222 None] Deleting offline snapshot a3db0ed9-f223-4816-be8c-a66508ca6a4a of volume 21e345c0-aa34-41f4-a16c-82cae2283e8f {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:47:11 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-2bb7d25c-b6eb-45d9-b1b3-fc2ca75d524b tempest-CreateVolumesFromSnapshotTest-1385949222 None] snapshot_file for this snap is: volume-21e345c0-aa34-41f4-a16c-82cae2283e8f.a3db0ed9-f223-4816-be8c-a66508ca6a4a {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:47:11 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ea008d-b932-47b2-832f-731a157672b0]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2bb7d25c-b6eb-45d9-b1b3-fc2ca75d524b tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f.a3db0ed9-f223-4816-be8c-a66508ca6a4a {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:11 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f.a3db0ed9-f223-4816-be8c-a66508ca6a4a Apr 02 12:47:11 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:11 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17" returned: 0 in 0.565s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.5ea1f492-104a-4e7e-9070-da80894595a7 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:11 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.5ea1f492-104a-4e7e-9070-da80894595a7 Apr 02 12:47:11 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:11 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-5ee50793-7206-44bd-845b-2a54e66cff4f tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.583s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:11 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-5ee50793-7206-44bd-845b-2a54e66cff4f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:47:11 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-5ee50793-7206-44bd-845b-2a54e66cff4f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Deleted volume successfully. Apr 02 12:47:11 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-5ee50793-7206-44bd-845b-2a54e66cff4f tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-1981ae70-d84e-49dc-8ee5-964360194915-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:11 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2bb7d25c-b6eb-45d9-b1b3-fc2ca75d524b tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f.a3db0ed9-f223-4816-be8c-a66508ca6a4a" returned: 0 in 0.638s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:11 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-2bb7d25c-b6eb-45d9-b1b3-fc2ca75d524b tempest-CreateVolumesFromSnapshotTest-1385949222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21e345c0-aa34-41f4-a16c-82cae2283e8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:47:11 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d954be72-0e4e-4b4e-838d-caf593e3a1a7]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2bb7d25c-b6eb-45d9-b1b3-fc2ca75d524b tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:11 devstack sudo[91002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f Apr 02 12:47:11 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:11 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.5ea1f492-104a-4e7e-9070-da80894595a7" returned: 0 in 0.494s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:11 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.5ea1f492-104a-4e7e-9070-da80894595a7 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:11 devstack sudo[91005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.5ea1f492-104a-4e7e-9070-da80894595a7 Apr 02 12:47:11 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:12 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17.5ea1f492-104a-4e7e-9070-da80894595a7" returned: 0 in 0.433s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:12 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2bb7d25c-b6eb-45d9-b1b3-fc2ca75d524b tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f" returned: 0 in 0.580s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2bb7d25c-b6eb-45d9-b1b3-fc2ca75d524b tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f.a3db0ed9-f223-4816-be8c-a66508ca6a4a {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:12 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Lock "cinder-quobyte-5ea1f492-104a-4e7e-9070-da80894595a7" released by "_delete_snapshot" :: held 2.044s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:12 devstack sudo[91011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f.a3db0ed9-f223-4816-be8c-a66508ca6a4a Apr 02 12:47:12 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.554s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a1a0de3c-c774-4983-9b92-6d69154605fc tempest-CinderUnicodeTest-967695934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.796s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:12 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-a1a0de3c-c774-4983-9b92-6d69154605fc tempest-CinderUnicodeTest-967695934 None] Creating offline snapshot 2e6cb808-4e16-49a2-99b3-8e780933bd4f of volume acb78b0a-852a-4038-bc9b-eee25223d876 {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:47:12 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce56b715-6479-4580-8669-f64edc22d4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45616de2-2a7f-4160-ac73-165668cb0341', 'volume_size': 1, 'source_volid': '9032e5f4-cf5c-403c-9d5b-6855892d8e17', 'source_volstatus': 'available'}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:12 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c7fe1f3-4ab2-49e1-9729-fb362b8dc4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:12 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d994579f-4cf8-4913-8e74-f68194ab618a]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a1a0de3c-c774-4983-9b92-6d69154605fc tempest-CinderUnicodeTest-967695934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:12 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Volume volume-45616de2-2a7f-4160-ac73-165668cb0341 (45616de2-2a7f-4160-ac73-165668cb0341): created successfully Apr 02 12:47:12 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c7fe1f3-4ab2-49e1-9729-fb362b8dc4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:12 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Flow 'volume_create_manager' (9106c7a3-39c3-456f-a214-e55d619d6d32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:47:12 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-68e1c98b-f43c-4920-a205-dff1e5f9efc4 tempest-VolumeDependencyTests-768920191 None] Created volume successfully. Apr 02 12:47:12 devstack sudo[91013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876 Apr 02 12:47:12 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:12 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2bb7d25c-b6eb-45d9-b1b3-fc2ca75d524b tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f.a3db0ed9-f223-4816-be8c-a66508ca6a4a" returned: 0 in 0.495s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2bb7d25c-b6eb-45d9-b1b3-fc2ca75d524b tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f.a3db0ed9-f223-4816-be8c-a66508ca6a4a {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:12 devstack sudo[91018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f.a3db0ed9-f223-4816-be8c-a66508ca6a4a Apr 02 12:47:12 devstack sudo[91018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:12 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a1a0de3c-c774-4983-9b92-6d69154605fc tempest-CinderUnicodeTest-967695934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876" returned: 0 in 0.579s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:12 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a1a0de3c-c774-4983-9b92-6d69154605fc tempest-CinderUnicodeTest-967695934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876.2e6cb808-4e16-49a2-99b3-8e780933bd4f 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:13 devstack sudo[91023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876.2e6cb808-4e16-49a2-99b3-8e780933bd4f 1G Apr 02 12:47:13 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:13 devstack cinder-volume[82819]: DEBUG oslo_service.periodic_task [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82819) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 12:47:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:47:13 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:47:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:13 devstack sudo[91025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:47:13 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:13 devstack sudo[91018]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-2bb7d25c-b6eb-45d9-b1b3-fc2ca75d524b tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f.a3db0ed9-f223-4816-be8c-a66508ca6a4a" returned: 0 in 0.448s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:13 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2bb7d25c-b6eb-45d9-b1b3-fc2ca75d524b tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-quobyte-a3db0ed9-f223-4816-be8c-a66508ca6a4a" released by "_delete_snapshot" :: held 2.223s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:13 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2bb7d25c-b6eb-45d9-b1b3-fc2ca75d524b tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-quobyte-21e345c0-aa34-41f4-a16c-82cae2283e8f" released by "delete_snapshot" :: held 2.231s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:13 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-2bb7d25c-b6eb-45d9-b1b3-fc2ca75d524b tempest-CreateVolumesFromSnapshotTest-1385949222 None] Created reservations ['8096e09a-5fca-488c-801a-8cfea2d9c155', '28cfc87f-f6cf-46c6-8bc7-295b10686eaf', 'c8c7b86b-b66d-4f40-9229-3a31966fc79f', '05c80f20-445e-4bc4-ac1f-7fa9a030503c'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:47:13 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-2bb7d25c-b6eb-45d9-b1b3-fc2ca75d524b tempest-CreateVolumesFromSnapshotTest-1385949222 None] Delete snapshot completed successfully. Apr 02 12:47:13 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-2bb7d25c-b6eb-45d9-b1b3-fc2ca75d524b tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-a3db0ed9-f223-4816-be8c-a66508ca6a4a-delete_snapshot" released by "delete_snapshot" :: held 2.319s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:13 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-27f75e2f-3a20-4327-ba4a-2b376bece280 tempest-VolumeDependencyTests-768920191 None] Acquiring lock "cinder-9032e5f4-cf5c-403c-9d5b-6855892d8e17-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:13 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-27f75e2f-3a20-4327-ba4a-2b376bece280 tempest-VolumeDependencyTests-768920191 None] Lock "cinder-9032e5f4-cf5c-403c-9d5b-6855892d8e17-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:13 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-27f75e2f-3a20-4327-ba4a-2b376bece280 tempest-VolumeDependencyTests-768920191 None] Acquiring lock "cinder-quobyte-9032e5f4-cf5c-403c-9d5b-6855892d8e17" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:13 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-27f75e2f-3a20-4327-ba4a-2b376bece280 tempest-VolumeDependencyTests-768920191 None] Lock "cinder-quobyte-9032e5f4-cf5c-403c-9d5b-6855892d8e17" acquired by "delete_volume" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:13 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0eafdd-9e08-4f39-8696-4d1c5ecffaf8]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-27f75e2f-3a20-4327-ba4a-2b376bece280 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:13 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a1a0de3c-c774-4983-9b92-6d69154605fc tempest-CinderUnicodeTest-967695934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876.2e6cb808-4e16-49a2-99b3-8e780933bd4f 1G" returned: 0 in 0.574s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a1a0de3c-c774-4983-9b92-6d69154605fc tempest-CinderUnicodeTest-967695934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acb78b0a-852a-4038-bc9b-eee25223d876 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876.2e6cb808-4e16-49a2-99b3-8e780933bd4f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:13 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:13 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.512s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:13 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-cc50584d-fa0c-4a7d-a56c-5ce48e370bc0 None None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:47:13 devstack sudo[91033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acb78b0a-852a-4038-bc9b-eee25223d876 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876.2e6cb808-4e16-49a2-99b3-8e780933bd4f Apr 02 12:47:13 devstack sudo[91033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:13 devstack sudo[91032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17 Apr 02 12:47:13 devstack sudo[91032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:14 devstack sudo[91033]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a1a0de3c-c774-4983-9b92-6d69154605fc tempest-CinderUnicodeTest-967695934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acb78b0a-852a-4038-bc9b-eee25223d876 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876.2e6cb808-4e16-49a2-99b3-8e780933bd4f" returned: 0 in 0.456s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:14 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-a1a0de3c-c774-4983-9b92-6d69154605fc tempest-CinderUnicodeTest-967695934 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876.2e6cb808-4e16-49a2-99b3-8e780933bd4f is being set with open permissions: ugo+rw Apr 02 12:47:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a1a0de3c-c774-4983-9b92-6d69154605fc tempest-CinderUnicodeTest-967695934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876.2e6cb808-4e16-49a2-99b3-8e780933bd4f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:14 devstack sudo[91042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876.2e6cb808-4e16-49a2-99b3-8e780933bd4f Apr 02 12:47:14 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:14 devstack sudo[91032]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-27f75e2f-3a20-4327-ba4a-2b376bece280 tempest-VolumeDependencyTests-768920191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17" returned: 0 in 0.518s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-27f75e2f-3a20-4327-ba4a-2b376bece280 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:14 devstack sudo[91044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17 Apr 02 12:47:14 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:14 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e1a64f39-51d8-4274-b634-91e8b10ba4fd tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "cinder-21e345c0-aa34-41f4-a16c-82cae2283e8f-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:14 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e1a64f39-51d8-4274-b634-91e8b10ba4fd tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-21e345c0-aa34-41f4-a16c-82cae2283e8f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:14 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e1a64f39-51d8-4274-b634-91e8b10ba4fd tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "cinder-quobyte-21e345c0-aa34-41f4-a16c-82cae2283e8f" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:14 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e1a64f39-51d8-4274-b634-91e8b10ba4fd tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-quobyte-21e345c0-aa34-41f4-a16c-82cae2283e8f" acquired by "delete_volume" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:14 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecaaf84-4d12-48dd-9e9d-329b203dc3cf]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e1a64f39-51d8-4274-b634-91e8b10ba4fd tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:14 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f Apr 02 12:47:14 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:14 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:14 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a1a0de3c-c774-4983-9b92-6d69154605fc tempest-CinderUnicodeTest-967695934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876.2e6cb808-4e16-49a2-99b3-8e780933bd4f" returned: 0 in 0.497s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-27f75e2f-3a20-4327-ba4a-2b376bece280 tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-9032e5f4-cf5c-403c-9d5b-6855892d8e17" returned: 0 in 0.465s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:14 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-27f75e2f-3a20-4327-ba4a-2b376bece280 tempest-VolumeDependencyTests-768920191 None] Lock "cinder-quobyte-9032e5f4-cf5c-403c-9d5b-6855892d8e17" released by "delete_volume" :: held 1.040s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:14 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-27f75e2f-3a20-4327-ba4a-2b376bece280 tempest-VolumeDependencyTests-768920191 None] Created reservations ['68afa827-0b84-4cfe-a838-20af19e083d2', '3a313fbf-846c-4510-98f5-a664b9bfb787', '82c2a52a-7884-45ca-bb53-65f4bbc4f661', 'aa9406b8-832b-4855-9105-862ff268836e'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:47:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a1a0de3c-c774-4983-9b92-6d69154605fc tempest-CinderUnicodeTest-967695934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:14 devstack sudo[91050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876.info Apr 02 12:47:14 devstack sudo[91050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-27f75e2f-3a20-4327-ba4a-2b376bece280 tempest-VolumeDependencyTests-768920191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-27f75e2f-3a20-4327-ba4a-2b376bece280 tempest-VolumeDependencyTests-768920191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:14 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-27f75e2f-3a20-4327-ba4a-2b376bece280 tempest-VolumeDependencyTests-768920191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:47:14 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-27f75e2f-3a20-4327-ba4a-2b376bece280 tempest-VolumeDependencyTests-768920191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:47:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-27f75e2f-3a20-4327-ba4a-2b376bece280 tempest-VolumeDependencyTests-768920191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-27f75e2f-3a20-4327-ba4a-2b376bece280 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:14 devstack sudo[91052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:47:14 devstack sudo[91052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:14 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e1a64f39-51d8-4274-b634-91e8b10ba4fd tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f" returned: 0 in 0.498s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:14 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e1a64f39-51d8-4274-b634-91e8b10ba4fd tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:14 devstack sudo[91057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f Apr 02 12:47:14 devstack sudo[91057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:15 devstack sudo[91050]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a1a0de3c-c774-4983-9b92-6d69154605fc tempest-CinderUnicodeTest-967695934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876.info" returned: 0 in 0.427s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:15 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-a1a0de3c-c774-4983-9b92-6d69154605fc tempest-CinderUnicodeTest-967695934 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876.info is being set with open permissions: ugo+rw Apr 02 12:47:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a1a0de3c-c774-4983-9b92-6d69154605fc tempest-CinderUnicodeTest-967695934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:15 devstack sudo[91061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876.info Apr 02 12:47:15 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:15 devstack sudo[91052]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-27f75e2f-3a20-4327-ba4a-2b376bece280 tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.413s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:15 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-27f75e2f-3a20-4327-ba4a-2b376bece280 tempest-VolumeDependencyTests-768920191 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:47:15 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-27f75e2f-3a20-4327-ba4a-2b376bece280 tempest-VolumeDependencyTests-768920191 None] Deleted volume successfully. Apr 02 12:47:15 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-27f75e2f-3a20-4327-ba4a-2b376bece280 tempest-VolumeDependencyTests-768920191 None] Lock "cinder-9032e5f4-cf5c-403c-9d5b-6855892d8e17-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:15 devstack sudo[91057]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e1a64f39-51d8-4274-b634-91e8b10ba4fd tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-21e345c0-aa34-41f4-a16c-82cae2283e8f" returned: 0 in 0.475s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:15 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e1a64f39-51d8-4274-b634-91e8b10ba4fd tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-quobyte-21e345c0-aa34-41f4-a16c-82cae2283e8f" released by "delete_volume" :: held 1.005s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:15 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-e1a64f39-51d8-4274-b634-91e8b10ba4fd tempest-CreateVolumesFromSnapshotTest-1385949222 None] Created reservations ['bd45f66e-c875-4d4c-af78-4fdf26c3be76', '96a073a7-ac25-42a4-8adf-e700d773e753', '353fe9f8-d16e-40f7-a0b0-19cd7dc38d1e', '641c091c-1cf8-41e1-a14d-331b0573ab98'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:47:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e1a64f39-51d8-4274-b634-91e8b10ba4fd tempest-CreateVolumesFromSnapshotTest-1385949222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e1a64f39-51d8-4274-b634-91e8b10ba4fd tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:15 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e1a64f39-51d8-4274-b634-91e8b10ba4fd tempest-CreateVolumesFromSnapshotTest-1385949222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:47:15 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e1a64f39-51d8-4274-b634-91e8b10ba4fd tempest-CreateVolumesFromSnapshotTest-1385949222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:47:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e1a64f39-51d8-4274-b634-91e8b10ba4fd tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e1a64f39-51d8-4274-b634-91e8b10ba4fd tempest-CreateVolumesFromSnapshotTest-1385949222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:15 devstack sudo[91064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:47:15 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:15 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-a1a0de3c-c774-4983-9b92-6d69154605fc tempest-CinderUnicodeTest-967695934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876.info" returned: 0 in 0.527s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-a1a0de3c-c774-4983-9b92-6d69154605fc tempest-CinderUnicodeTest-967695934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.213s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:15 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-a1a0de3c-c774-4983-9b92-6d69154605fc tempest-CinderUnicodeTest-967695934 None] Create snapshot completed successfully Apr 02 12:47:15 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-fb62f0fc-e5c3-490a-830a-47a8fe2128b8 tempest-VolumeDependencyTests-768920191 None] Acquiring lock "cinder-45616de2-2a7f-4160-ac73-165668cb0341-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:15 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-fb62f0fc-e5c3-490a-830a-47a8fe2128b8 tempest-VolumeDependencyTests-768920191 None] Lock "cinder-45616de2-2a7f-4160-ac73-165668cb0341-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:15 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-fb62f0fc-e5c3-490a-830a-47a8fe2128b8 tempest-VolumeDependencyTests-768920191 None] Acquiring lock "cinder-quobyte-45616de2-2a7f-4160-ac73-165668cb0341" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:15 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-fb62f0fc-e5c3-490a-830a-47a8fe2128b8 tempest-VolumeDependencyTests-768920191 None] Lock "cinder-quobyte-45616de2-2a7f-4160-ac73-165668cb0341" acquired by "delete_volume" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:15 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[257a503d-1f56-44d7-8370-111f1abe8d27]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fb62f0fc-e5c3-490a-830a-47a8fe2128b8 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-45616de2-2a7f-4160-ac73-165668cb0341 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:15 devstack sudo[91067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-45616de2-2a7f-4160-ac73-165668cb0341 Apr 02 12:47:15 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:15 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:15 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e1a64f39-51d8-4274-b634-91e8b10ba4fd tempest-CreateVolumesFromSnapshotTest-1385949222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.562s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:15 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-e1a64f39-51d8-4274-b634-91e8b10ba4fd tempest-CreateVolumesFromSnapshotTest-1385949222 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:47:15 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-e1a64f39-51d8-4274-b634-91e8b10ba4fd tempest-CreateVolumesFromSnapshotTest-1385949222 None] Deleted volume successfully. Apr 02 12:47:15 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e1a64f39-51d8-4274-b634-91e8b10ba4fd tempest-CreateVolumesFromSnapshotTest-1385949222 None] Lock "cinder-21e345c0-aa34-41f4-a16c-82cae2283e8f-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-66893bf1-c64a-407f-8eed-100993afceb6 tempest-CinderUnicodeTest-967695934 None] Acquiring lock "cinder-2e6cb808-4e16-49a2-99b3-8e780933bd4f-delete_snapshot" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-66893bf1-c64a-407f-8eed-100993afceb6 tempest-CinderUnicodeTest-967695934 None] Lock "cinder-2e6cb808-4e16-49a2-99b3-8e780933bd4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-66893bf1-c64a-407f-8eed-100993afceb6 tempest-CinderUnicodeTest-967695934 None] Acquiring lock "cinder-quobyte-acb78b0a-852a-4038-bc9b-eee25223d876" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-66893bf1-c64a-407f-8eed-100993afceb6 tempest-CinderUnicodeTest-967695934 None] Lock "cinder-quobyte-acb78b0a-852a-4038-bc9b-eee25223d876" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-66893bf1-c64a-407f-8eed-100993afceb6 tempest-CinderUnicodeTest-967695934 None] Acquiring lock "cinder-quobyte-2e6cb808-4e16-49a2-99b3-8e780933bd4f" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-66893bf1-c64a-407f-8eed-100993afceb6 tempest-CinderUnicodeTest-967695934 None] Lock "cinder-quobyte-2e6cb808-4e16-49a2-99b3-8e780933bd4f" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:16 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-66893bf1-c64a-407f-8eed-100993afceb6 tempest-CinderUnicodeTest-967695934 None] Deleting offline snapshot 2e6cb808-4e16-49a2-99b3-8e780933bd4f of volume acb78b0a-852a-4038-bc9b-eee25223d876 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:47:16 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-66893bf1-c64a-407f-8eed-100993afceb6 tempest-CinderUnicodeTest-967695934 None] snapshot_file for this snap is: volume-acb78b0a-852a-4038-bc9b-eee25223d876.2e6cb808-4e16-49a2-99b3-8e780933bd4f {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:47:16 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[386f1a33-b933-4b44-aaa8-99571e039aa4]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-66893bf1-c64a-407f-8eed-100993afceb6 tempest-CinderUnicodeTest-967695934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876.2e6cb808-4e16-49a2-99b3-8e780933bd4f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:16 devstack sudo[91070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876.2e6cb808-4e16-49a2-99b3-8e780933bd4f Apr 02 12:47:16 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:16 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fb62f0fc-e5c3-490a-830a-47a8fe2128b8 tempest-VolumeDependencyTests-768920191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-45616de2-2a7f-4160-ac73-165668cb0341" returned: 0 in 0.596s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fb62f0fc-e5c3-490a-830a-47a8fe2128b8 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-45616de2-2a7f-4160-ac73-165668cb0341 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:16 devstack sudo[91075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-45616de2-2a7f-4160-ac73-165668cb0341 Apr 02 12:47:16 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:16 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-66893bf1-c64a-407f-8eed-100993afceb6 tempest-CinderUnicodeTest-967695934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876.2e6cb808-4e16-49a2-99b3-8e780933bd4f" returned: 0 in 0.790s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:16 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-66893bf1-c64a-407f-8eed-100993afceb6 tempest-CinderUnicodeTest-967695934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acb78b0a-852a-4038-bc9b-eee25223d876(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:47:16 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d19bdee-e05b-4044-93e1-d21e15df1486]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-66893bf1-c64a-407f-8eed-100993afceb6 tempest-CinderUnicodeTest-967695934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:16 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:16 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fb62f0fc-e5c3-490a-830a-47a8fe2128b8 tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-45616de2-2a7f-4160-ac73-165668cb0341" returned: 0 in 0.564s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:16 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-fb62f0fc-e5c3-490a-830a-47a8fe2128b8 tempest-VolumeDependencyTests-768920191 None] Lock "cinder-quobyte-45616de2-2a7f-4160-ac73-165668cb0341" released by "delete_volume" :: held 1.189s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:16 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-fb62f0fc-e5c3-490a-830a-47a8fe2128b8 tempest-VolumeDependencyTests-768920191 None] Created reservations ['7e9d41cf-6202-4342-b009-c2363ae18b75', '2cccbd7c-8fd3-4455-ba74-7ee624c80468', 'd9003590-6209-4177-ad03-980f6fe9a420', '74c4c8ac-a8de-4e83-bcc0-1900ce1ced12'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:47:17 devstack sudo[91081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876 Apr 02 12:47:17 devstack sudo[91081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-fb62f0fc-e5c3-490a-830a-47a8fe2128b8 tempest-VolumeDependencyTests-768920191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-fb62f0fc-e5c3-490a-830a-47a8fe2128b8 tempest-VolumeDependencyTests-768920191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:17 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-fb62f0fc-e5c3-490a-830a-47a8fe2128b8 tempest-VolumeDependencyTests-768920191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:47:17 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-fb62f0fc-e5c3-490a-830a-47a8fe2128b8 tempest-VolumeDependencyTests-768920191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:47:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-fb62f0fc-e5c3-490a-830a-47a8fe2128b8 tempest-VolumeDependencyTests-768920191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fb62f0fc-e5c3-490a-830a-47a8fe2128b8 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:17 devstack sudo[91083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:47:17 devstack sudo[91083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:17 devstack sudo[91081]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-66893bf1-c64a-407f-8eed-100993afceb6 tempest-CinderUnicodeTest-967695934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876" returned: 0 in 0.662s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-66893bf1-c64a-407f-8eed-100993afceb6 tempest-CinderUnicodeTest-967695934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876.2e6cb808-4e16-49a2-99b3-8e780933bd4f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:17 devstack sudo[91089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876.2e6cb808-4e16-49a2-99b3-8e780933bd4f Apr 02 12:47:17 devstack sudo[91089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:17 devstack sudo[91083]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:17 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-fb62f0fc-e5c3-490a-830a-47a8fe2128b8 tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.538s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:17 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-fb62f0fc-e5c3-490a-830a-47a8fe2128b8 tempest-VolumeDependencyTests-768920191 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:47:17 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-fb62f0fc-e5c3-490a-830a-47a8fe2128b8 tempest-VolumeDependencyTests-768920191 None] Deleted volume successfully. Apr 02 12:47:17 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-fb62f0fc-e5c3-490a-830a-47a8fe2128b8 tempest-VolumeDependencyTests-768920191 None] Lock "cinder-45616de2-2a7f-4160-ac73-165668cb0341-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:17 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-47d9f51c-097a-490b-a1f8-c65938235b50 tempest-VolumeDependencyTests-768920191 None] Acquiring lock "cinder-ba61afe2-58e2-41dd-85e5-61e62a0637ee-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:17 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-47d9f51c-097a-490b-a1f8-c65938235b50 tempest-VolumeDependencyTests-768920191 None] Lock "cinder-ba61afe2-58e2-41dd-85e5-61e62a0637ee-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-47d9f51c-097a-490b-a1f8-c65938235b50 tempest-VolumeDependencyTests-768920191 None] Acquiring lock "cinder-quobyte-ba61afe2-58e2-41dd-85e5-61e62a0637ee" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-47d9f51c-097a-490b-a1f8-c65938235b50 tempest-VolumeDependencyTests-768920191 None] Lock "cinder-quobyte-ba61afe2-58e2-41dd-85e5-61e62a0637ee" acquired by "delete_volume" :: waited 0.010s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:18 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a58d922-1121-41a8-8802-9b7d87b013a5]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-47d9f51c-097a-490b-a1f8-c65938235b50 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ba61afe2-58e2-41dd-85e5-61e62a0637ee {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:18 devstack sudo[91094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ba61afe2-58e2-41dd-85e5-61e62a0637ee Apr 02 12:47:18 devstack sudo[91094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:18 devstack sudo[91089]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-66893bf1-c64a-407f-8eed-100993afceb6 tempest-CinderUnicodeTest-967695934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876.2e6cb808-4e16-49a2-99b3-8e780933bd4f" returned: 0 in 0.696s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-66893bf1-c64a-407f-8eed-100993afceb6 tempest-CinderUnicodeTest-967695934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876.2e6cb808-4e16-49a2-99b3-8e780933bd4f {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:18 devstack sudo[91097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876.2e6cb808-4e16-49a2-99b3-8e780933bd4f Apr 02 12:47:18 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:18 devstack sudo[91094]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-47d9f51c-097a-490b-a1f8-c65938235b50 tempest-VolumeDependencyTests-768920191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ba61afe2-58e2-41dd-85e5-61e62a0637ee" returned: 0 in 0.638s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-47d9f51c-097a-490b-a1f8-c65938235b50 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ba61afe2-58e2-41dd-85e5-61e62a0637ee {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:18 devstack sudo[91102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ba61afe2-58e2-41dd-85e5-61e62a0637ee Apr 02 12:47:18 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:18 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:18 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-66893bf1-c64a-407f-8eed-100993afceb6 tempest-CinderUnicodeTest-967695934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876.2e6cb808-4e16-49a2-99b3-8e780933bd4f" returned: 0 in 0.684s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-66893bf1-c64a-407f-8eed-100993afceb6 tempest-CinderUnicodeTest-967695934 None] Lock "cinder-quobyte-2e6cb808-4e16-49a2-99b3-8e780933bd4f" released by "_delete_snapshot" :: held 2.901s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:18 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-66893bf1-c64a-407f-8eed-100993afceb6 tempest-CinderUnicodeTest-967695934 None] Lock "cinder-quobyte-acb78b0a-852a-4038-bc9b-eee25223d876" released by "delete_snapshot" :: held 2.922s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-66893bf1-c64a-407f-8eed-100993afceb6 tempest-CinderUnicodeTest-967695934 None] Created reservations ['b214b7ec-d0dc-490d-ae81-d8d82c3c38dc', 'e262322d-73be-470f-bcf1-8c7933b5a9ac', '973445e0-6c85-41fb-a6c6-bdd9fe733482', '2b21b85b-4d37-4418-baf8-7244600ca63b'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:47:19 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-66893bf1-c64a-407f-8eed-100993afceb6 tempest-CinderUnicodeTest-967695934 None] Delete snapshot completed successfully. Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-66893bf1-c64a-407f-8eed-100993afceb6 tempest-CinderUnicodeTest-967695934 None] Lock "cinder-2e6cb808-4e16-49a2-99b3-8e780933bd4f-delete_snapshot" released by "delete_snapshot" :: held 3.048s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:19 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-47d9f51c-097a-490b-a1f8-c65938235b50 tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-ba61afe2-58e2-41dd-85e5-61e62a0637ee" returned: 0 in 0.502s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-47d9f51c-097a-490b-a1f8-c65938235b50 tempest-VolumeDependencyTests-768920191 None] Lock "cinder-quobyte-ba61afe2-58e2-41dd-85e5-61e62a0637ee" released by "delete_volume" :: held 1.172s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e9234f52-eb69-4cba-8c6b-fde66936bf08 tempest-CinderUnicodeTest-967695934 None] Acquiring lock "cinder-acb78b0a-852a-4038-bc9b-eee25223d876-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e9234f52-eb69-4cba-8c6b-fde66936bf08 tempest-CinderUnicodeTest-967695934 None] Lock "cinder-acb78b0a-852a-4038-bc9b-eee25223d876-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e9234f52-eb69-4cba-8c6b-fde66936bf08 tempest-CinderUnicodeTest-967695934 None] Acquiring lock "cinder-quobyte-acb78b0a-852a-4038-bc9b-eee25223d876" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-47d9f51c-097a-490b-a1f8-c65938235b50 tempest-VolumeDependencyTests-768920191 None] Created reservations ['bd74d6b1-d016-4920-b825-6632e87bf4b5', '49561a59-113d-4025-90ba-1087f81f7be6', 'd2485d4f-b71b-4610-b72f-462088b931d5', '490548d6-9491-4d37-93b6-2e45aca490ac'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e9234f52-eb69-4cba-8c6b-fde66936bf08 tempest-CinderUnicodeTest-967695934 None] Lock "cinder-quobyte-acb78b0a-852a-4038-bc9b-eee25223d876" acquired by "delete_volume" :: waited 0.025s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[458c101c-dc8c-4c23-b255-10f230303745]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e9234f52-eb69-4cba-8c6b-fde66936bf08 tempest-CinderUnicodeTest-967695934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-47d9f51c-097a-490b-a1f8-c65938235b50 tempest-VolumeDependencyTests-768920191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-47d9f51c-097a-490b-a1f8-c65938235b50 tempest-VolumeDependencyTests-768920191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-47d9f51c-097a-490b-a1f8-c65938235b50 tempest-VolumeDependencyTests-768920191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-47d9f51c-097a-490b-a1f8-c65938235b50 tempest-VolumeDependencyTests-768920191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-47d9f51c-097a-490b-a1f8-c65938235b50 tempest-VolumeDependencyTests-768920191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-47d9f51c-097a-490b-a1f8-c65938235b50 tempest-VolumeDependencyTests-768920191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:19 devstack sudo[91107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:47:19 devstack sudo[91107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:19 devstack sudo[91106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876 Apr 02 12:47:19 devstack sudo[91106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Flow 'volume_create_manager' (c9544f63-7d5b-45db-a87f-0c01e6a9e021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd75ea43-6623-469a-bebe-24467c1675ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd75ea43-6623-469a-bebe-24467c1675ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-746943021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54898c39-c21e-4d23-b472-2c36e36b65c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0bce670dfc41ef949878e5ff77fb58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:47:19Z,use_quota=True,user_id='54372a6829fa473eb95e72d96c413f85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc0821d-a9fe-4038-9a14-9751e0af01af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc0821d-a9fe-4038-9a14-9751e0af01af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (363eedbd-28b9-4478-8188-cc0ab06215a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (363eedbd-28b9-4478-8188-cc0ab06215a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54898c39-c21e-4d23-b472-2c36e36b65c2', 'volume_name': 'volume-54898c39-c21e-4d23-b472-2c36e36b65c2', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c44a5e5-897b-4be7-9b29-0b5a9435f9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c44a5e5-897b-4be7-9b29-0b5a9435f9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee63935-4ee9-428a-98ce-6eb52a3d23a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:19 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Volume 54898c39-c21e-4d23-b472-2c36e36b65c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54898c39-c21e-4d23-b472-2c36e36b65c2', 'volume_size': 1} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-746943021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54898c39-c21e-4d23-b472-2c36e36b65c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0bce670dfc41ef949878e5ff77fb58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:47:19Z,use_quota=True,user_id='54372a6829fa473eb95e72d96c413f85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)}" {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Creating volume 54898c39-c21e-4d23-b472-2c36e36b65c2 {{(pid=82819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:47:19 devstack cinder-volume[82819]: INFO cinder.volume.drivers.remotefs [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] casted to osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2 1073741824 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:19 devstack sudo[91110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2 1073741824 Apr 02 12:47:19 devstack sudo[91110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:19 devstack sudo[91106]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e9234f52-eb69-4cba-8c6b-fde66936bf08 tempest-CinderUnicodeTest-967695934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876" returned: 0 in 0.518s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e9234f52-eb69-4cba-8c6b-fde66936bf08 tempest-CinderUnicodeTest-967695934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:19 devstack sudo[91118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876 Apr 02 12:47:19 devstack sudo[91118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:19 devstack sudo[91107]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-47d9f51c-097a-490b-a1f8-c65938235b50 tempest-VolumeDependencyTests-768920191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.464s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-47d9f51c-097a-490b-a1f8-c65938235b50 tempest-VolumeDependencyTests-768920191 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:47:19 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-47d9f51c-097a-490b-a1f8-c65938235b50 tempest-VolumeDependencyTests-768920191 None] Deleted volume successfully. Apr 02 12:47:19 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-47d9f51c-097a-490b-a1f8-c65938235b50 tempest-VolumeDependencyTests-768920191 None] Lock "cinder-ba61afe2-58e2-41dd-85e5-61e62a0637ee-delete_volume" released by "delete_volume" :: held 1.976s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:20 devstack sudo[91110]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2 1073741824" returned: 0 in 0.473s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:20 devstack sudo[91121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2 Apr 02 12:47:20 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:20 devstack sudo[91118]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e9234f52-eb69-4cba-8c6b-fde66936bf08 tempest-CinderUnicodeTest-967695934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-acb78b0a-852a-4038-bc9b-eee25223d876" returned: 0 in 0.433s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:20 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e9234f52-eb69-4cba-8c6b-fde66936bf08 tempest-CinderUnicodeTest-967695934 None] Lock "cinder-quobyte-acb78b0a-852a-4038-bc9b-eee25223d876" released by "delete_volume" :: held 1.021s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:20 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-e9234f52-eb69-4cba-8c6b-fde66936bf08 tempest-CinderUnicodeTest-967695934 None] Created reservations ['d18437de-baa9-437f-819c-8f2344b9ecc5', '30de08db-a59d-438a-aaa5-23d5ec3ca79d', '47a604f7-dab7-4c33-b3ef-6fb13adcdcf1', '293b5082-aaf3-49ba-b520-015bbd463727'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:47:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e9234f52-eb69-4cba-8c6b-fde66936bf08 tempest-CinderUnicodeTest-967695934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e9234f52-eb69-4cba-8c6b-fde66936bf08 tempest-CinderUnicodeTest-967695934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:20 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e9234f52-eb69-4cba-8c6b-fde66936bf08 tempest-CinderUnicodeTest-967695934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:47:20 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-e9234f52-eb69-4cba-8c6b-fde66936bf08 tempest-CinderUnicodeTest-967695934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:47:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-e9234f52-eb69-4cba-8c6b-fde66936bf08 tempest-CinderUnicodeTest-967695934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e9234f52-eb69-4cba-8c6b-fde66936bf08 tempest-CinderUnicodeTest-967695934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:20 devstack sudo[91125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:47:20 devstack sudo[91125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:20 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2" returned: 0 in 0.468s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:20 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'} {{(pid=82819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 12:47:20 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:20 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee63935-4ee9-428a-98ce-6eb52a3d23a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54898c39-c21e-4d23-b472-2c36e36b65c2', 'volume_size': 1}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:20 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d10ba1-b702-4158-b5fb-66acb982849d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:20 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Volume volume-54898c39-c21e-4d23-b472-2c36e36b65c2 (54898c39-c21e-4d23-b472-2c36e36b65c2): created successfully Apr 02 12:47:20 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d10ba1-b702-4158-b5fb-66acb982849d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:20 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Flow 'volume_create_manager' (c9544f63-7d5b-45db-a87f-0c01e6a9e021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:47:20 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-8d9e847f-9868-41af-b741-68bd679a278e tempest-SnapshotDependencyTests-697933672 None] Created volume successfully. Apr 02 12:47:21 devstack sudo[91125]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-e9234f52-eb69-4cba-8c6b-fde66936bf08 tempest-CinderUnicodeTest-967695934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.547s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:21 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-e9234f52-eb69-4cba-8c6b-fde66936bf08 tempest-CinderUnicodeTest-967695934 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:47:21 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-e9234f52-eb69-4cba-8c6b-fde66936bf08 tempest-CinderUnicodeTest-967695934 None] Deleted volume successfully. Apr 02 12:47:21 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-e9234f52-eb69-4cba-8c6b-fde66936bf08 tempest-CinderUnicodeTest-967695934 None] Lock "cinder-acb78b0a-852a-4038-bc9b-eee25223d876-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:21 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-622ecb20-2213-4b69-a6de-293a2563daa3 tempest-CinderUnicodeTest-967695934 None] Acquiring lock "cinder-67767d6b-d9ab-4a59-b27a-617c699b7147-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:21 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-622ecb20-2213-4b69-a6de-293a2563daa3 tempest-CinderUnicodeTest-967695934 None] Lock "cinder-67767d6b-d9ab-4a59-b27a-617c699b7147-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:21 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-622ecb20-2213-4b69-a6de-293a2563daa3 tempest-CinderUnicodeTest-967695934 None] Acquiring lock "cinder-quobyte-67767d6b-d9ab-4a59-b27a-617c699b7147" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:21 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-622ecb20-2213-4b69-a6de-293a2563daa3 tempest-CinderUnicodeTest-967695934 None] Lock "cinder-quobyte-67767d6b-d9ab-4a59-b27a-617c699b7147" acquired by "delete_volume" :: waited 0.012s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:21 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[95eba902-1a44-4a74-8eb9-b344e437f578]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-622ecb20-2213-4b69-a6de-293a2563daa3 tempest-CinderUnicodeTest-967695934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-67767d6b-d9ab-4a59-b27a-617c699b7147 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:21 devstack sudo[91128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-67767d6b-d9ab-4a59-b27a-617c699b7147 Apr 02 12:47:21 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6138323d-bbf8-4e01-b88c-5661a8b35d99 tempest-SnapshotDependencyTests-697933672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6138323d-bbf8-4e01-b88c-5661a8b35d99 tempest-SnapshotDependencyTests-697933672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:21 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-6138323d-bbf8-4e01-b88c-5661a8b35d99 tempest-SnapshotDependencyTests-697933672 None] Creating offline snapshot 99a1ed61-4efe-43fa-9d55-5be4c07d9f9c of volume 54898c39-c21e-4d23-b472-2c36e36b65c2 {{(pid=82819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 12:47:21 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d167ae10-3285-4f82-9aff-15fc91462cd0]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6138323d-bbf8-4e01-b88c-5661a8b35d99 tempest-SnapshotDependencyTests-697933672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:21 devstack sudo[91131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2 Apr 02 12:47:21 devstack sudo[91131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:21 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-622ecb20-2213-4b69-a6de-293a2563daa3 tempest-CinderUnicodeTest-967695934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-67767d6b-d9ab-4a59-b27a-617c699b7147" returned: 0 in 0.448s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:21 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-622ecb20-2213-4b69-a6de-293a2563daa3 tempest-CinderUnicodeTest-967695934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-67767d6b-d9ab-4a59-b27a-617c699b7147 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:21 devstack sudo[91135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-67767d6b-d9ab-4a59-b27a-617c699b7147 Apr 02 12:47:21 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:22 devstack sudo[91131]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6138323d-bbf8-4e01-b88c-5661a8b35d99 tempest-SnapshotDependencyTests-697933672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2" returned: 0 in 0.451s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6138323d-bbf8-4e01-b88c-5661a8b35d99 tempest-SnapshotDependencyTests-697933672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.99a1ed61-4efe-43fa-9d55-5be4c07d9f9c 1G {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:22 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.99a1ed61-4efe-43fa-9d55-5be4c07d9f9c 1G Apr 02 12:47:22 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:22 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-622ecb20-2213-4b69-a6de-293a2563daa3 tempest-CinderUnicodeTest-967695934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-67767d6b-d9ab-4a59-b27a-617c699b7147" returned: 0 in 0.411s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:22 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-622ecb20-2213-4b69-a6de-293a2563daa3 tempest-CinderUnicodeTest-967695934 None] Lock "cinder-quobyte-67767d6b-d9ab-4a59-b27a-617c699b7147" released by "delete_volume" :: held 0.881s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:22 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-622ecb20-2213-4b69-a6de-293a2563daa3 tempest-CinderUnicodeTest-967695934 None] Created reservations ['4a2f56f0-1cc6-427a-b129-5eeef193269f', 'c1803b9c-3258-41ae-b2fe-1ebc4570c63f', '4ff9404a-2669-4a10-ab55-613ff392b74e', '72135ff7-e941-4a45-84cc-7b4e2033fea2'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:47:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-622ecb20-2213-4b69-a6de-293a2563daa3 tempest-CinderUnicodeTest-967695934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-622ecb20-2213-4b69-a6de-293a2563daa3 tempest-CinderUnicodeTest-967695934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:22 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-622ecb20-2213-4b69-a6de-293a2563daa3 tempest-CinderUnicodeTest-967695934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:47:22 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-622ecb20-2213-4b69-a6de-293a2563daa3 tempest-CinderUnicodeTest-967695934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:47:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-622ecb20-2213-4b69-a6de-293a2563daa3 tempest-CinderUnicodeTest-967695934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-622ecb20-2213-4b69-a6de-293a2563daa3 tempest-CinderUnicodeTest-967695934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:22 devstack sudo[91143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:47:22 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:22 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6138323d-bbf8-4e01-b88c-5661a8b35d99 tempest-SnapshotDependencyTests-697933672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.99a1ed61-4efe-43fa-9d55-5be4c07d9f9c 1G" returned: 0 in 0.534s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6138323d-bbf8-4e01-b88c-5661a8b35d99 tempest-SnapshotDependencyTests-697933672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54898c39-c21e-4d23-b472-2c36e36b65c2 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.99a1ed61-4efe-43fa-9d55-5be4c07d9f9c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:22 devstack sudo[91149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54898c39-c21e-4d23-b472-2c36e36b65c2 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.99a1ed61-4efe-43fa-9d55-5be4c07d9f9c Apr 02 12:47:22 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:22 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:22 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-622ecb20-2213-4b69-a6de-293a2563daa3 tempest-CinderUnicodeTest-967695934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.458s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:22 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-622ecb20-2213-4b69-a6de-293a2563daa3 tempest-CinderUnicodeTest-967695934 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:47:22 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-622ecb20-2213-4b69-a6de-293a2563daa3 tempest-CinderUnicodeTest-967695934 None] Deleted volume successfully. Apr 02 12:47:22 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-622ecb20-2213-4b69-a6de-293a2563daa3 tempest-CinderUnicodeTest-967695934 None] Lock "cinder-67767d6b-d9ab-4a59-b27a-617c699b7147-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:23 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6138323d-bbf8-4e01-b88c-5661a8b35d99 tempest-SnapshotDependencyTests-697933672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54898c39-c21e-4d23-b472-2c36e36b65c2 -F qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.99a1ed61-4efe-43fa-9d55-5be4c07d9f9c" returned: 0 in 0.479s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:23 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-6138323d-bbf8-4e01-b88c-5661a8b35d99 tempest-SnapshotDependencyTests-697933672 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.99a1ed61-4efe-43fa-9d55-5be4c07d9f9c is being set with open permissions: ugo+rw Apr 02 12:47:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6138323d-bbf8-4e01-b88c-5661a8b35d99 tempest-SnapshotDependencyTests-697933672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.99a1ed61-4efe-43fa-9d55-5be4c07d9f9c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:23 devstack sudo[91154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.99a1ed61-4efe-43fa-9d55-5be4c07d9f9c Apr 02 12:47:23 devstack sudo[91154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:23 devstack sudo[91154]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6138323d-bbf8-4e01-b88c-5661a8b35d99 tempest-SnapshotDependencyTests-697933672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.99a1ed61-4efe-43fa-9d55-5be4c07d9f9c" returned: 0 in 0.394s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:23 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6138323d-bbf8-4e01-b88c-5661a8b35d99 tempest-SnapshotDependencyTests-697933672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:23 devstack sudo[91157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.info Apr 02 12:47:23 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:24 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6138323d-bbf8-4e01-b88c-5661a8b35d99 tempest-SnapshotDependencyTests-697933672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.info" returned: 0 in 0.401s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:24 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-6138323d-bbf8-4e01-b88c-5661a8b35d99 tempest-SnapshotDependencyTests-697933672 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.info is being set with open permissions: ugo+rw Apr 02 12:47:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6138323d-bbf8-4e01-b88c-5661a8b35d99 tempest-SnapshotDependencyTests-697933672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.info {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:24 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.info Apr 02 12:47:24 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:24 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-6138323d-bbf8-4e01-b88c-5661a8b35d99 tempest-SnapshotDependencyTests-697933672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.info" returned: 0 in 0.370s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:24 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-6138323d-bbf8-4e01-b88c-5661a8b35d99 tempest-SnapshotDependencyTests-697933672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.687s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:24 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-6138323d-bbf8-4e01-b88c-5661a8b35d99 tempest-SnapshotDependencyTests-697933672 None] Create snapshot completed successfully Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG cinder.volume.flows.manager.create_volume [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Flow 'volume_create_manager' (77cd57bb-6f69-4dbe-8aee-cb1cc57a3155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc2ddbca-06c3-4885-bcd0-58126f8fe14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc2ddbca-06c3-4885-bcd0-58126f8fe14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T10:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41937fd-ba72-44be-8d37-9b52fc2b8643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0bce670dfc41ef949878e5ff77fb58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T10:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=99a1ed61-4efe-43fa-9d55-5be4c07d9f9c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T10:47:25Z,use_quota=True,user_id='54372a6829fa473eb95e72d96c413f85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a3ada3-802d-4f11-9b80-78d0b526200d),volume_type_id=79a3ada3-802d-4f11-9b80-78d0b526200d)' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a037aac1-7993-428c-abe7-3e9ab018ccd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a037aac1-7993-428c-abe7-3e9ab018ccd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6249edb9-91a5-4ae9-bf75-a1937ef677a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6249edb9-91a5-4ae9-bf75-a1937ef677a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a41937fd-ba72-44be-8d37-9b52fc2b8643', 'volume_name': 'volume-a41937fd-ba72-44be-8d37-9b52fc2b8643', 'volume_size': 1, 'snapshot_id': '99a1ed61-4efe-43fa-9d55-5be4c07d9f9c'}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fcd415e-2f5c-47e1-b187-d731da2c9227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fcd415e-2f5c-47e1-b187-d731da2c9227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9ec25b7-eb61-44ee-9cf7-e98f010adee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:25 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Volume a41937fd-ba72-44be-8d37-9b52fc2b8643: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a41937fd-ba72-44be-8d37-9b52fc2b8643', 'volume_size': 1, 'snapshot_id': '99a1ed61-4efe-43fa-9d55-5be4c07d9f9c'} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Acquiring lock "cinder-quobyte-99a1ed61-4efe-43fa-9d55-5be4c07d9f9c-a41937fd-ba72-44be-8d37-9b52fc2b8643" by "_create_volume_from_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Lock "cinder-quobyte-99a1ed61-4efe-43fa-9d55-5be4c07d9f9c-a41937fd-ba72-44be-8d37-9b52fc2b8643" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Creating volume a41937fd-ba72-44be-8d37-9b52fc2b8643 from snapshot 99a1ed61-4efe-43fa-9d55-5be4c07d9f9c {{(pid=82819) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Selected osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea as target Quobyte volume. {{(pid=82819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Acquiring lock "cinder-quobyte-a41937fd-ba72-44be-8d37-9b52fc2b8643" by "_copy_volume_from_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Lock "cinder-quobyte-a41937fd-ba72-44be-8d37-9b52fc2b8643" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] snapshot: 99a1ed61-4efe-43fa-9d55-5be4c07d9f9c, volume: a41937fd-ba72-44be-8d37-9b52fc2b8643, {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d601c3e8-945d-4ed3-8372-b90b71cd6897]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.99a1ed61-4efe-43fa-9d55-5be4c07d9f9c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:25 devstack sudo[91163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.99a1ed61-4efe-43fa-9d55-5be4c07d9f9c Apr 02 12:47:25 devstack sudo[91163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:25 devstack sudo[91163]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.99a1ed61-4efe-43fa-9d55-5be4c07d9f9c" returned: 0 in 0.454s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54898c39-c21e-4d23-b472-2c36e36b65c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2 {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Creating direct copy from snapshot {{(pid=82819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[876d9f03-fc44-473f-99b3-d961da554233]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:25 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:25 devstack sudo[91168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2 Apr 02 12:47:25 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:26 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2" returned: 0 in 0.465s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:26 devstack cinder-volume[82819]: DEBUG cinder.utils [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Path /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a41937fd-ba72-44be-8d37-9b52fc2b8643 not found in is_blk_device check {{(pid=82819) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 12:47:26 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a41937fd-ba72-44be-8d37-9b52fc2b8643 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:26 devstack sudo[91173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a41937fd-ba72-44be-8d37-9b52fc2b8643 Apr 02 12:47:26 devstack sudo[91173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:28 devstack sudo[91173]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a41937fd-ba72-44be-8d37-9b52fc2b8643" returned: 0 in 2.000s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:28 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[10983750-d8e7-478c-9dc1-82bd412cec96]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:28 devstack sudo[91186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2 Apr 02 12:47:28 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:28 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2" returned: 0 in 0.567s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:28 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2, size 1024.00 MB, duration 2.00 sec, destination /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a41937fd-ba72-44be-8d37-9b52fc2b8643 {{(pid=82819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 12:47:28 devstack cinder-volume[82819]: INFO cinder.image.image_utils [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Converted 1024.00 MB image at 511.74 MB/s Apr 02 12:47:28 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.remotefs [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a41937fd-ba72-44be-8d37-9b52fc2b8643 is being set with open permissions: ugo+rw Apr 02 12:47:28 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a41937fd-ba72-44be-8d37-9b52fc2b8643 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:28 devstack sudo[91191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a41937fd-ba72-44be-8d37-9b52fc2b8643 Apr 02 12:47:28 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:29 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a41937fd-ba72-44be-8d37-9b52fc2b8643" returned: 0 in 0.378s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:29 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Lock "cinder-quobyte-a41937fd-ba72-44be-8d37-9b52fc2b8643" released by "_copy_volume_from_snapshot" :: held 3.917s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:29 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Lock "cinder-quobyte-99a1ed61-4efe-43fa-9d55-5be4c07d9f9c-a41937fd-ba72-44be-8d37-9b52fc2b8643" released by "_create_volume_from_snapshot" :: held 3.933s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.941s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:29 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9ec25b7-eb61-44ee-9cf7-e98f010adee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a41937fd-ba72-44be-8d37-9b52fc2b8643', 'volume_size': 1, 'snapshot_id': '99a1ed61-4efe-43fa-9d55-5be4c07d9f9c'}' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:29 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (051a672c-97c8-4ddc-b4aa-4d71483b7cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 12:47:29 devstack cinder-volume[82819]: INFO cinder.volume.flows.manager.create_volume [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Volume volume-a41937fd-ba72-44be-8d37-9b52fc2b8643 (a41937fd-ba72-44be-8d37-9b52fc2b8643): created successfully Apr 02 12:47:29 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (051a672c-97c8-4ddc-b4aa-4d71483b7cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82819) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 12:47:29 devstack cinder-volume[82819]: DEBUG cinder.volume.manager [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Flow 'volume_create_manager' (77cd57bb-6f69-4dbe-8aee-cb1cc57a3155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82819) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 12:47:29 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-10615180-f48a-4ef9-8e9f-120c030ffab2 tempest-SnapshotDependencyTests-697933672 None] Created volume successfully. Apr 02 12:47:29 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-199d9140-c814-4c29-bee6-7fa929d64240 tempest-SnapshotDependencyTests-697933672 None] Acquiring lock "cinder-99a1ed61-4efe-43fa-9d55-5be4c07d9f9c-delete_snapshot" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:29 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-199d9140-c814-4c29-bee6-7fa929d64240 tempest-SnapshotDependencyTests-697933672 None] Lock "cinder-99a1ed61-4efe-43fa-9d55-5be4c07d9f9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:29 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-199d9140-c814-4c29-bee6-7fa929d64240 tempest-SnapshotDependencyTests-697933672 None] Acquiring lock "cinder-quobyte-54898c39-c21e-4d23-b472-2c36e36b65c2" by "delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:29 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-199d9140-c814-4c29-bee6-7fa929d64240 tempest-SnapshotDependencyTests-697933672 None] Lock "cinder-quobyte-54898c39-c21e-4d23-b472-2c36e36b65c2" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:29 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-199d9140-c814-4c29-bee6-7fa929d64240 tempest-SnapshotDependencyTests-697933672 None] Acquiring lock "cinder-quobyte-99a1ed61-4efe-43fa-9d55-5be4c07d9f9c" by "_delete_snapshot" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:29 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-199d9140-c814-4c29-bee6-7fa929d64240 tempest-SnapshotDependencyTests-697933672 None] Lock "cinder-quobyte-99a1ed61-4efe-43fa-9d55-5be4c07d9f9c" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:29 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-199d9140-c814-4c29-bee6-7fa929d64240 tempest-SnapshotDependencyTests-697933672 None] Deleting offline snapshot 99a1ed61-4efe-43fa-9d55-5be4c07d9f9c of volume 54898c39-c21e-4d23-b472-2c36e36b65c2 {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 12:47:29 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-199d9140-c814-4c29-bee6-7fa929d64240 tempest-SnapshotDependencyTests-697933672 None] snapshot_file for this snap is: volume-54898c39-c21e-4d23-b472-2c36e36b65c2.99a1ed61-4efe-43fa-9d55-5be4c07d9f9c {{(pid=82819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 12:47:29 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde47161-b911-411b-bbd5-da71400e2985]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:29 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-199d9140-c814-4c29-bee6-7fa929d64240 tempest-SnapshotDependencyTests-697933672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.99a1ed61-4efe-43fa-9d55-5be4c07d9f9c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:29 devstack sudo[91194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.99a1ed61-4efe-43fa-9d55-5be4c07d9f9c Apr 02 12:47:29 devstack sudo[91194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:30 devstack sudo[91194]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-199d9140-c814-4c29-bee6-7fa929d64240 tempest-SnapshotDependencyTests-697933672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.99a1ed61-4efe-43fa-9d55-5be4c07d9f9c" returned: 0 in 0.460s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:30 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-199d9140-c814-4c29-bee6-7fa929d64240 tempest-SnapshotDependencyTests-697933672 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54898c39-c21e-4d23-b472-2c36e36b65c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 12:47:30 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cdf9c1-f20e-4bb4-bde3-def7f1a946ab]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-199d9140-c814-4c29-bee6-7fa929d64240 tempest-SnapshotDependencyTests-697933672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:30 devstack sudo[91199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2 Apr 02 12:47:30 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:30 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-199d9140-c814-4c29-bee6-7fa929d64240 tempest-SnapshotDependencyTests-697933672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2" returned: 0 in 0.447s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-199d9140-c814-4c29-bee6-7fa929d64240 tempest-SnapshotDependencyTests-697933672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.99a1ed61-4efe-43fa-9d55-5be4c07d9f9c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:30 devstack sudo[91204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.99a1ed61-4efe-43fa-9d55-5be4c07d9f9c Apr 02 12:47:30 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:30 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-199d9140-c814-4c29-bee6-7fa929d64240 tempest-SnapshotDependencyTests-697933672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.99a1ed61-4efe-43fa-9d55-5be4c07d9f9c" returned: 0 in 0.437s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:30 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-199d9140-c814-4c29-bee6-7fa929d64240 tempest-SnapshotDependencyTests-697933672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.99a1ed61-4efe-43fa-9d55-5be4c07d9f9c {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:30 devstack sudo[91209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.99a1ed61-4efe-43fa-9d55-5be4c07d9f9c Apr 02 12:47:30 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:31 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-199d9140-c814-4c29-bee6-7fa929d64240 tempest-SnapshotDependencyTests-697933672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2.99a1ed61-4efe-43fa-9d55-5be4c07d9f9c" returned: 0 in 0.391s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:31 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-199d9140-c814-4c29-bee6-7fa929d64240 tempest-SnapshotDependencyTests-697933672 None] Lock "cinder-quobyte-99a1ed61-4efe-43fa-9d55-5be4c07d9f9c" released by "_delete_snapshot" :: held 1.784s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:31 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-199d9140-c814-4c29-bee6-7fa929d64240 tempest-SnapshotDependencyTests-697933672 None] Lock "cinder-quobyte-54898c39-c21e-4d23-b472-2c36e36b65c2" released by "delete_snapshot" :: held 1.799s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:31 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:SELECT=189,cinder:UPDATE=261,cinder:INSERT=81,cinder:DELETE=31 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:47:31 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-199d9140-c814-4c29-bee6-7fa929d64240 tempest-SnapshotDependencyTests-697933672 None] Created reservations ['c757a2a1-b20a-43bf-82e9-637bdc36d2e9', '44eb239c-0d04-45be-8e01-037e855392a5', 'a38d3215-fe71-4360-9de2-47f380134ead', '15b47cbf-ddfa-4128-81bd-dd6ee0c23493'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:47:31 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-199d9140-c814-4c29-bee6-7fa929d64240 tempest-SnapshotDependencyTests-697933672 None] Delete snapshot completed successfully. Apr 02 12:47:31 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-199d9140-c814-4c29-bee6-7fa929d64240 tempest-SnapshotDependencyTests-697933672 None] Lock "cinder-99a1ed61-4efe-43fa-9d55-5be4c07d9f9c-delete_snapshot" released by "delete_snapshot" :: held 1.886s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:31 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-91d92748-d6bd-4f72-be49-a76a01eedede tempest-SnapshotDependencyTests-697933672 None] Acquiring lock "cinder-54898c39-c21e-4d23-b472-2c36e36b65c2-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:31 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-91d92748-d6bd-4f72-be49-a76a01eedede tempest-SnapshotDependencyTests-697933672 None] Lock "cinder-54898c39-c21e-4d23-b472-2c36e36b65c2-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:31 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:SELECT=221,cinder:UPDATE=311,cinder:DELETE=21,cinder:INSERT=52 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:47:31 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-91d92748-d6bd-4f72-be49-a76a01eedede tempest-SnapshotDependencyTests-697933672 None] Acquiring lock "cinder-quobyte-54898c39-c21e-4d23-b472-2c36e36b65c2" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:31 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-91d92748-d6bd-4f72-be49-a76a01eedede tempest-SnapshotDependencyTests-697933672 None] Lock "cinder-quobyte-54898c39-c21e-4d23-b472-2c36e36b65c2" acquired by "delete_volume" :: waited 0.009s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:31 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[2658a9ee-bc86-4105-b568-42fd46a29b05]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:31 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-91d92748-d6bd-4f72-be49-a76a01eedede tempest-SnapshotDependencyTests-697933672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:31 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2 Apr 02 12:47:31 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:32 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-91d92748-d6bd-4f72-be49-a76a01eedede tempest-SnapshotDependencyTests-697933672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2" returned: 0 in 0.423s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-91d92748-d6bd-4f72-be49-a76a01eedede tempest-SnapshotDependencyTests-697933672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:32 devstack sudo[91217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2 Apr 02 12:47:32 devstack sudo[91217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:32 devstack sudo[91217]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-91d92748-d6bd-4f72-be49-a76a01eedede tempest-SnapshotDependencyTests-697933672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-54898c39-c21e-4d23-b472-2c36e36b65c2" returned: 0 in 0.389s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:32 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-91d92748-d6bd-4f72-be49-a76a01eedede tempest-SnapshotDependencyTests-697933672 None] Lock "cinder-quobyte-54898c39-c21e-4d23-b472-2c36e36b65c2" released by "delete_volume" :: held 0.851s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:32 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-91d92748-d6bd-4f72-be49-a76a01eedede tempest-SnapshotDependencyTests-697933672 None] Created reservations ['922c0e12-10f6-478e-a20b-4d2d98031f78', '0965e1a3-4d3c-4309-b8f5-eb3d68ddaa90', 'd78d0913-4281-4a1c-aaa8-e50cf25b8035', '1355f626-9827-43d5-a498-27b851fe263f'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:47:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-91d92748-d6bd-4f72-be49-a76a01eedede tempest-SnapshotDependencyTests-697933672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-91d92748-d6bd-4f72-be49-a76a01eedede tempest-SnapshotDependencyTests-697933672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-91d92748-d6bd-4f72-be49-a76a01eedede tempest-SnapshotDependencyTests-697933672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:47:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-91d92748-d6bd-4f72-be49-a76a01eedede tempest-SnapshotDependencyTests-697933672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:47:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-91d92748-d6bd-4f72-be49-a76a01eedede tempest-SnapshotDependencyTests-697933672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-91d92748-d6bd-4f72-be49-a76a01eedede tempest-SnapshotDependencyTests-697933672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:32 devstack sudo[91220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:47:32 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:32 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d30ed523-f0ae-4e3c-a1aa-b09da9421152 tempest-SnapshotDependencyTests-697933672 None] Acquiring lock "cinder-a41937fd-ba72-44be-8d37-9b52fc2b8643-delete_volume" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:32 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d30ed523-f0ae-4e3c-a1aa-b09da9421152 tempest-SnapshotDependencyTests-697933672 None] Lock "cinder-a41937fd-ba72-44be-8d37-9b52fc2b8643-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:32 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d30ed523-f0ae-4e3c-a1aa-b09da9421152 tempest-SnapshotDependencyTests-697933672 None] Acquiring lock "cinder-quobyte-a41937fd-ba72-44be-8d37-9b52fc2b8643" by "delete_volume" {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 12:47:32 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d30ed523-f0ae-4e3c-a1aa-b09da9421152 tempest-SnapshotDependencyTests-697933672 None] Lock "cinder-quobyte-a41937fd-ba72-44be-8d37-9b52fc2b8643" acquired by "delete_volume" :: waited 0.007s {{(pid=82819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 12:47:32 devstack cinder-volume[82819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95792b3-328e-4398-b746-3326aad28ff5]: (4, 'qcow2') {{(pid=83541) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 12:47:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d30ed523-f0ae-4e3c-a1aa-b09da9421152 tempest-SnapshotDependencyTests-697933672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a41937fd-ba72-44be-8d37-9b52fc2b8643 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:32 devstack sudo[91222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a41937fd-ba72-44be-8d37-9b52fc2b8643 Apr 02 12:47:32 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:32 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-91d92748-d6bd-4f72-be49-a76a01eedede tempest-SnapshotDependencyTests-697933672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.403s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:32 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-91d92748-d6bd-4f72-be49-a76a01eedede tempest-SnapshotDependencyTests-697933672 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:47:32 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-91d92748-d6bd-4f72-be49-a76a01eedede tempest-SnapshotDependencyTests-697933672 None] Deleted volume successfully. Apr 02 12:47:33 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-91d92748-d6bd-4f72-be49-a76a01eedede tempest-SnapshotDependencyTests-697933672 None] Lock "cinder-54898c39-c21e-4d23-b472-2c36e36b65c2-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:33 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d30ed523-f0ae-4e3c-a1aa-b09da9421152 tempest-SnapshotDependencyTests-697933672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a41937fd-ba72-44be-8d37-9b52fc2b8643" returned: 0 in 0.430s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d30ed523-f0ae-4e3c-a1aa-b09da9421152 tempest-SnapshotDependencyTests-697933672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a41937fd-ba72-44be-8d37-9b52fc2b8643 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:33 devstack sudo[91228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a41937fd-ba72-44be-8d37-9b52fc2b8643 Apr 02 12:47:33 devstack sudo[91228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:33 devstack sudo[91228]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d30ed523-f0ae-4e3c-a1aa-b09da9421152 tempest-SnapshotDependencyTests-697933672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64/volume-a41937fd-ba72-44be-8d37-9b52fc2b8643" returned: 0 in 0.371s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:33 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d30ed523-f0ae-4e3c-a1aa-b09da9421152 tempest-SnapshotDependencyTests-697933672 None] Lock "cinder-quobyte-a41937fd-ba72-44be-8d37-9b52fc2b8643" released by "delete_volume" :: held 0.831s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:33 devstack cinder-volume[82819]: DEBUG cinder.quota [None req-d30ed523-f0ae-4e3c-a1aa-b09da9421152 tempest-SnapshotDependencyTests-697933672 None] Created reservations ['72eec8f9-c861-4088-bf2b-ef00f3537cb6', 'f2a27b95-1f6e-4dc9-a9c1-1a128a2bbcf5', 'b72fc877-87c8-4fe3-8886-4438674133ec', 'abcbfe25-fd88-4db5-a8ec-40c5d8a16e32'] {{(pid=82819) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 12:47:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d30ed523-f0ae-4e3c-a1aa-b09da9421152 tempest-SnapshotDependencyTests-697933672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 12:47:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d30ed523-f0ae-4e3c-a1aa-b09da9421152 tempest-SnapshotDependencyTests-697933672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 12:47:33 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-d30ed523-f0ae-4e3c-a1aa-b09da9421152 tempest-SnapshotDependencyTests-697933672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 12:47:33 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-d30ed523-f0ae-4e3c-a1aa-b09da9421152 tempest-SnapshotDependencyTests-697933672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-62ac7b53-d716-4f52-8cda-aa4c16538eea'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 12:47:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-d30ed523-f0ae-4e3c-a1aa-b09da9421152 tempest-SnapshotDependencyTests-697933672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 12:47:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d30ed523-f0ae-4e3c-a1aa-b09da9421152 tempest-SnapshotDependencyTests-697933672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 12:47:33 devstack sudo[91231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64 Apr 02 12:47:33 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 12:47:34 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root Apr 02 12:47:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-d30ed523-f0ae-4e3c-a1aa-b09da9421152 tempest-SnapshotDependencyTests-697933672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b9027602a8454fd027448043277ef64" returned: 0 in 0.387s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 12:47:34 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-d30ed523-f0ae-4e3c-a1aa-b09da9421152 tempest-SnapshotDependencyTests-697933672 None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 12:47:34 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-d30ed523-f0ae-4e3c-a1aa-b09da9421152 tempest-SnapshotDependencyTests-697933672 None] Deleted volume successfully. Apr 02 12:47:34 devstack cinder-volume[82819]: DEBUG cinder.coordination [None req-d30ed523-f0ae-4e3c-a1aa-b09da9421152 tempest-SnapshotDependencyTests-697933672 None] Lock "cinder-a41937fd-ba72-44be-8d37-9b52fc2b8643-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=82819) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 12:47:43 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:SELECT=15,cinder:INSERT=9,cinder:UPDATE=15 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 12:47:44 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=18,cinder:DELETE=2 {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}